Apr 18 17:46:17 user devstack@n-api.service[61067]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 17:46:17 user devstack@n-api.service[61067]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 17:46:17 2023] *** Apr 18 17:46:17 user devstack@n-api.service[61067]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 17:46:17 user devstack@n-api.service[61067]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 17:46:17 user devstack@n-api.service[61067]: nodename: user Apr 18 17:46:17 user devstack@n-api.service[61067]: machine: x86_64 Apr 18 17:46:17 user devstack@n-api.service[61067]: clock source: unix Apr 18 17:46:17 user devstack@n-api.service[61067]: pcre jit disabled Apr 18 17:46:17 user devstack@n-api.service[61067]: detected number of CPU cores: 12 Apr 18 17:46:17 user devstack@n-api.service[61067]: current working directory: / Apr 18 17:46:17 user devstack@n-api.service[61067]: detected binary path: /usr/bin/uwsgi-core Apr 18 17:46:17 user devstack@n-api.service[61067]: your processes number limit is 63637 Apr 18 17:46:17 user devstack@n-api.service[61067]: your memory page size is 4096 bytes Apr 18 17:46:17 user devstack@n-api.service[61067]: detected max file descriptor number: 2048 Apr 18 17:46:17 user devstack@n-api.service[61067]: lock engine: pthread robust mutexes Apr 18 17:46:17 user devstack@n-api.service[61067]: thunder lock: enabled Apr 18 17:46:17 user devstack@n-api.service[61067]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 17:46:17 user devstack@n-api.service[61067]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 17:46:17 user devstack@n-api.service[61067]: Python main interpreter initialized at 0x55cccd408990 Apr 18 17:46:17 user devstack@n-api.service[61067]: python threads support enabled Apr 18 17:46:17 user devstack@n-api.service[61067]: your server socket listen backlog is limited to 100 connections Apr 18 17:46:17 user devstack@n-api.service[61067]: your mercy for graceful operations on workers is 90 seconds Apr 18 17:46:17 user devstack@n-api.service[61067]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 17:46:17 user devstack@n-api.service[61067]: *** Operational MODE: preforking *** Apr 18 17:46:17 user devstack@n-api.service[61067]: *** uWSGI is running in multiple interpreter mode *** Apr 18 17:46:17 user devstack@n-api.service[61067]: spawned uWSGI master process (pid: 61067) Apr 18 17:46:17 user devstack@n-api.service[61067]: spawned uWSGI worker 1 (pid: 61068, cores: 1) Apr 18 17:46:17 user devstack@n-api.service[61067]: spawned uWSGI worker 2 (pid: 61069, cores: 1) Apr 18 17:46:17 user devstack@n-api.service[61067]: spawned uWSGI worker 3 (pid: 61070, cores: 1) Apr 18 17:46:17 user devstack@n-api.service[61067]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 17:46:18 user devstack@n-api.service[61070]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 17:46:18 user devstack@n-api.service[61068]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 17:46:18 user devstack@n-api.service[61069]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 17:46:21 user devstack@n-api.service[61068]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 17:46:21 user devstack@n-api.service[61068]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 17:46:21 user devstack@n-api.service[61068]: and ``live_migration_inbound_addr`` respectively. Apr 18 17:46:21 user devstack@n-api.service[61068]: ). Its value may be silently ignored in the future. Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 17:46:21 user devstack@n-api.service[61069]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 17:46:21 user devstack@n-api.service[61069]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 17:46:21 user devstack@n-api.service[61069]: and ``live_migration_inbound_addr`` respectively. Apr 18 17:46:21 user devstack@n-api.service[61069]: ). Its value may be silently ignored in the future. Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 17:46:21 user devstack@n-api.service[61070]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 17:46:21 user devstack@n-api.service[61070]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 17:46:21 user devstack@n-api.service[61070]: and ``live_migration_inbound_addr`` respectively. Apr 18 17:46:21 user devstack@n-api.service[61070]: ). Its value may be silently ignored in the future. Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61068) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61069) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61068]: INFO dbcounter [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Registered counter for database nova_api Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61070) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_db.sqlalchemy.engines [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61068) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writer thread running {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG nova.context [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d27f925-8bed-44bf-a25d-45ceb80a7926(cell1) {{(pid=61068) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 17:46:21 user devstack@n-api.service[61070]: INFO dbcounter [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Registered counter for database nova_api Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:46:21 user devstack@n-api.service[61069]: INFO dbcounter [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Registered counter for database nova_api Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:46:21 user devstack@n-api.service[61068]: INFO dbcounter [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Registered counter for database nova_cell0 Apr 18 17:46:21 user devstack@n-api.service[61068]: INFO dbcounter [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Registered counter for database nova_cell1 Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61070) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_db.sqlalchemy.engines [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61068) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writer thread running {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writer thread running {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_db.sqlalchemy.engines [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61069) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_db.sqlalchemy.engines [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61068) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writer thread running {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG nova.context [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d27f925-8bed-44bf-a25d-45ceb80a7926(cell1) {{(pid=61070) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:46:21 user devstack@n-api.service[61070]: INFO dbcounter [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Registered counter for database nova_cell0 Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG nova.context [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9d27f925-8bed-44bf-a25d-45ceb80a7926(cell1) {{(pid=61069) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 17:46:21 user devstack@n-api.service[61070]: INFO dbcounter [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Registered counter for database nova_cell1 Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61070) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61069]: INFO dbcounter [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Registered counter for database nova_cell0 Apr 18 17:46:21 user devstack@n-api.service[61069]: INFO dbcounter [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Registered counter for database nova_cell1 Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writer thread running {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61070) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_db.sqlalchemy.engines [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61069) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writer thread running {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG oslo_db.sqlalchemy.engines [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61069) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writer thread running {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61068]: INFO dbcounter [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Registered counter for database nova_cell0 Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG oslo_db.sqlalchemy.engines [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61068) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writer thread running {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writer thread running {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61070]: INFO dbcounter [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Registered counter for database nova_cell0 Apr 18 17:46:21 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writer thread running {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG oslo_db.sqlalchemy.engines [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61070) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:21 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writer thread running {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:21 user devstack@n-api.service[61069]: INFO dbcounter [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Registered counter for database nova_cell0 Apr 18 17:46:22 user devstack@n-api.service[61069]: DEBUG oslo_db.sqlalchemy.engines [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61069) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 17:46:22 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writer thread running {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 17:46:22 user devstack@n-api.service[61068]: WARNING keystonemiddleware.auth_token [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 17:46:22 user devstack@n-api.service[61068]: WARNING keystonemiddleware.auth_token [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 17:46:22 user devstack@n-api.service[61070]: WARNING keystonemiddleware.auth_token [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 17:46:22 user devstack@n-api.service[61070]: WARNING keystonemiddleware.auth_token [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 17:46:22 user devstack@n-api.service[61069]: WARNING keystonemiddleware.auth_token [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 17:46:22 user devstack@n-api.service[61069]: WARNING keystonemiddleware.auth_token [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 17:46:22 user devstack@n-api.service[61068]: WARNING keystonemiddleware.auth_token [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 17:46:22 user devstack@n-api.service[61068]: WARNING keystonemiddleware.auth_token [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 17:46:22 user devstack@n-api.service[61068]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cccd408990 pid: 61068 (default app) Apr 18 17:46:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:46:22 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001495 Apr 18 17:46:22 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 17:46:22 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:46:22 user devstack@n-api.service[61069]: WARNING keystonemiddleware.auth_token [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 17:46:22 user devstack@n-api.service[61069]: WARNING keystonemiddleware.auth_token [None req-0f57f08e-2d2b-4f7c-9c29-3f8b5d7f15ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 17:46:22 user devstack@n-api.service[61069]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cccd408990 pid: 61069 (default app) Apr 18 17:46:22 user devstack@n-api.service[61070]: WARNING keystonemiddleware.auth_token [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 17:46:22 user devstack@n-api.service[61070]: WARNING keystonemiddleware.auth_token [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 17:46:22 user devstack@n-api.service[61070]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cccd408990 pid: 61070 (default app) Apr 18 17:48:26 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:26 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-bee02558-c72a-425d-80b8-461bbc94416d None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001578 Apr 18 17:48:26 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:26 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:26 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:26 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:26 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:26 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:26 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-1210f9e3-8105-4d43-bca0-86003bb4cd83 admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:26 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-1210f9e3-8105-4d43-bca0-86003bb4cd83 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.411864 Apr 18 17:48:26 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 17:48:26 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:29 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:29 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.005178 Apr 18 17:48:29 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:29 2023] GET /compute/v2.1 => generated 387 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:29 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=3 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:29 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=3 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:29 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=3 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:29 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:29 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-23a52d24-3c2d-41db-95b1-ab2fcb6bed37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "id": "c1"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:29 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-23a52d24-3c2d-41db-95b1-ab2fcb6bed37 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.330595 Apr 18 17:48:29 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:29 2023] POST /compute/v2.1/flavors => generated 405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:29 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-359d1522-06f6-4e7a-a3c7-49badc728654 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:29 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-359d1522-06f6-4e7a-a3c7-49badc728654 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058528 Apr 18 17:48:29 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 17:48:29 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:31 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:31 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001408 Apr 18 17:48:31 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:31 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3d3e1c0e-5242-4cb0-bf81-38dd02b67ab0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:31 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-3d3e1c0e-5242-4cb0-bf81-38dd02b67ab0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.104729 Apr 18 17:48:31 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:31 2023] POST /compute/v2.1/flavors => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:31 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-70b0e632-31f1-4418-8189-28b5767284da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:32 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-70b0e632-31f1-4418-8189-28b5767284da admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029924 Apr 18 17:48:32 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 17:48:31 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:34 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:34 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002400 Apr 18 17:48:34 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:34 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:34 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f0450c84-03b9-4d96-ac51-196b7c75cbe4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "ram": 1024, "name": "ds1G"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:34 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-f0450c84-03b9-4d96-ac51-196b7c75cbe4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060918 Apr 18 17:48:34 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:34 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:34 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-3e990497-075f-424a-b1ed-de97912b4fe5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:34 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-3e990497-075f-424a-b1ed-de97912b4fe5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034250 Apr 18 17:48:34 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 17:48:34 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 17:48:36 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:36 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001436 Apr 18 17:48:36 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:36 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:36 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-d4c08096-62dd-485c-8cb1-f0b91a638a61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "disk": 10}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:36 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-d4c08096-62dd-485c-8cb1-f0b91a638a61 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089700 Apr 18 17:48:36 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:36 2023] POST /compute/v2.1/flavors => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:36 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-05e170b8-2e69-4c13-a4b0-b05f83629758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:36 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-05e170b8-2e69-4c13-a4b0-b05f83629758 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025794 Apr 18 17:48:36 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 17:48:36 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:38 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:38 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002160 Apr 18 17:48:38 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:38 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:38 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f22bde5c-e450-495e-90dc-d068d135e8b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:38 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-f22bde5c-e450-495e-90dc-d068d135e8b2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058282 Apr 18 17:48:38 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:38 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:38 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:38 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039204 Apr 18 17:48:38 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 17:48:38 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:40 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:40 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2a8df72e-bb47-43e1-9fb4-c7b7426eb9e4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001948 Apr 18 17:48:40 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:40 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:40 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-8dbc5fc0-ec63-4609-af57-7e3aa159338d admin admin] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:40 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-8dbc5fc0-ec63-4609-af57-7e3aa159338d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.070056 Apr 18 17:48:40 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 17:48:40 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:48:42 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:42 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001809 Apr 18 17:48:42 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:42 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=3 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:42 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=3 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:42 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=3 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:42 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=3 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:48:42 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-8b3e9962-b220-474d-83ce-694b72b685c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "id": "1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:42 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-8b3e9962-b220-474d-83ce-694b72b685c5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.330683 Apr 18 17:48:42 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:42 2023] POST /compute/v2.1/flavors => generated 400 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-105d3ac3-14a9-408a-9935-5acae5ac50d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-105d3ac3-14a9-408a-9935-5acae5ac50d3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047551 Apr 18 17:48:42 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 17:48:42 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:44 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:44 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001279 Apr 18 17:48:44 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:44 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-a30376c6-1a55-4e74-a6f8-27e71a1602ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "id": "2"}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:44 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-a30376c6-1a55-4e74-a6f8-27e71a1602ea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060364 Apr 18 17:48:44 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:44 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:44 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-8ff453fc-b2d8-4325-8329-4df7080ee2eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-8ff453fc-b2d8-4325-8329-4df7080ee2eb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025023 Apr 18 17:48:44 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 17:48:44 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:46 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:46 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001324 Apr 18 17:48:46 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:46 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-6830fa78-0720-4566-afaf-8fe3221c8dad admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "id": "3", "disk": 40}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:46 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-6830fa78-0720-4566-afaf-8fe3221c8dad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061704 Apr 18 17:48:46 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:46 2023] POST /compute/v2.1/flavors => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 18 17:48:46 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-0304662e-7b47-4165-84ea-e591110e2382 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:46 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-0304662e-7b47-4165-84ea-e591110e2382 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023259 Apr 18 17:48:46 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 17:48:46 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:48 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:48 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002257 Apr 18 17:48:48 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:48 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:48 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-f5c5bf8e-8c8c-4afb-8b3a-b0635a13f186 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:48 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-f5c5bf8e-8c8c-4afb-8b3a-b0635a13f186 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.274684 Apr 18 17:48:48 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:48 2023] POST /compute/v2.1/flavors => generated 403 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:48 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-7734a587-3d70-4e6d-8ddf-6e7173d66071 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:48 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-7734a587-3d70-4e6d-8ddf-6e7173d66071 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023341 Apr 18 17:48:48 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 17:48:48 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:48:50 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:48:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002218 Apr 18 17:48:50 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 17:48:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:48:50 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-84cb4446-baeb-45b1-bbbc-08f579e29755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "swap": 0}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:50 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-84cb4446-baeb-45b1-bbbc-08f579e29755 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.065154 Apr 18 17:48:50 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 17:48:50 2023] POST /compute/v2.1/flavors => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:48:50 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-650a47e9-c47e-4fc4-b0ab-47f79815e406 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:48:50 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-650a47e9-c47e-4fc4-b0ab-47f79815e406 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023174 Apr 18 17:48:50 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 17:48:50 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:49:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:49:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be703aff-2617-48f4-aa27-a18f8f9cd34e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001588 Apr 18 17:49:21 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 17:49:21 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:49:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:49:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.087337 Apr 18 17:49:21 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 17:49:21 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:49:53 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-650a47e9-c47e-4fc4-b0ab-47f79815e406 admin admin] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:49:53 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-650a47e9-c47e-4fc4-b0ab-47f79815e406 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001547 Apr 18 17:49:53 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 17:49:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:49:53 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:49:53 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-811f8f5b-fa3a-4077-9bf0-62f1a1cbcfbd admin admin] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:49:53 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-811f8f5b-fa3a-4077-9bf0-62f1a1cbcfbd admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.069777 Apr 18 17:49:53 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 17:49:53 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 17:49:57 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:49:57 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001413 Apr 18 17:49:57 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 17:49:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:49:57 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:49:57 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-bb9d4dd2-7eef-4d18-9695-1cd2a6865b23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.nano", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "42", "ram": 128, "vcpus": 1, "swap": 0, "disk": 1}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:49:57 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-bb9d4dd2-7eef-4d18-9695-1cd2a6865b23 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.079355 Apr 18 17:49:57 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 17:49:57 2023] POST /compute/v2.1/flavors => generated 403 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:49:57 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-5ee66463-9ec4-4a72-9ed7-2cb1d531764e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:49:57 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-5ee66463-9ec4-4a72-9ed7-2cb1d531764e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025736 Apr 18 17:49:57 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 17:49:57 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:50:01 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:50:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2b5273d6-79f1-4e5c-93c3-24484d27ee03 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001791 Apr 18 17:50:01 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 17:50:01 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:50:01 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-58367dcc-847d-40d0-91ca-b6d6cd128544 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "id": "84", "ram": 192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.micro"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:50:01 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-58367dcc-847d-40d0-91ca-b6d6cd128544 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059537 Apr 18 17:50:01 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 17:50:01 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 17:50:01 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-8f290815-92c4-48a7-a133-141a07ba4c0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:50:01 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-8f290815-92c4-48a7-a133-141a07ba4c0e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024669 Apr 18 17:50:01 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 17:50:01 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:52:12 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:52:12 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:52:12 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:52:12 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-64e1cf68-555e-48e5-9f25-bd26b5b727b0 tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] Action: 'create', calling method: .version_select at 0x7fb35bf76950>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1820344627"}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:13 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-64e1cf68-555e-48e5-9f25-bd26b5b727b0 tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.647643 Apr 18 17:52:13 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 17:52:12 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1649 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 17:52:14 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:52:14 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-83edb5cb-ad52-443c-94a5-8f2af27512ea tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] Calling method '.version_select at 0x7fb35bfeef80>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:14 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-83edb5cb-ad52-443c-94a5-8f2af27512ea tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed" status: 200 len: 342 microversion: 2.1 time: 0.251355 Apr 18 17:52:14 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 17:52:14 2023] GET /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed => generated 342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:15 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:52:15 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-3af99f2b-c2d9-4d68-82c6-61e69b9dc4bc tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] Calling method '.version_select at 0x7fb35bf4ee60>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:15 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-3af99f2b-c2d9-4d68-82c6-61e69b9dc4bc tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed" status: 200 len: 342 microversion: 2.1 time: 0.474790 Apr 18 17:52:15 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 17:52:15 2023] GET /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed => generated 342 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:15 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-5b4d5c0e-b2ee-4b87-9213-35ebd6f47e9f tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] Calling method '.version_select at 0x7fb35be04160>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:15 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-5b4d5c0e-b2ee-4b87-9213-35ebd6f47e9f tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed" status: 202 len: 0 microversion: 2.1 time: 0.162966 Apr 18 17:52:15 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 17:52:15 2023] DELETE /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:52:15 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-bd4cd0ae-6cf2-4cb0-9bd2-344208cd2368 tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] Calling method '.version_select at 0x7fb35be8f010>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:16 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-bd4cd0ae-6cf2-4cb0-9bd2-344208cd2368 tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] HTTP exception thrown: Volume e54eb773-bbc4-4272-af22-3daa05b8eaed could not be found. Apr 18 17:52:16 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-bd4cd0ae-6cf2-4cb0-9bd2-344208cd2368 tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] Request method failure captured: Apr 18 17:52:16 user devstack@n-api.service[61068]: request: GET /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed HTTP/1.1 Apr 18 17:52:16 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:52:16 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:52:16 user devstack@n-api.service[61068]: Connection: close Apr 18 17:52:16 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 17:52:16 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:52:16 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:52:16 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:52:16 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjM-r5FHYGpOW2Efv5XUXo5j7IBlcZGWFU3Sm16wy-eJxR-6crQMHLUgqWxRzrcQvd8xn9U-dSv_r2KUc5sHU_s31F-rK69PRzPNXMG7nora1QqXl-Ef8b0XaTnuuTMsS7bwrfxT0z_GkQY7HKolHnIxmcP53REbqmghvKUz7uyKA8 Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Project-Id: 67463502c1b743a2ba42a2dded74af87 Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1827866213 Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67463502c1b743a2ba42a2dded74af87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/67463502c1b743a2ba42a2dded74af87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/67463502c1b743a2ba42a2dded74af87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1827866213 Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Tenant-Id: 67463502c1b743a2ba42a2dded74af87 Apr 18 17:52:16 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1827866213 Apr 18 17:52:16 user devstack@n-api.service[61068]: X-User: tempest-VolumesSnapshotsTestJSON-1827866213-project-member Apr 18 17:52:16 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:52:16 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:52:16 user devstack@n-api.service[61068]: X-User-Id: b9c8843c72a8401ca58e4d9094a9464e Apr 18 17:52:16 user devstack@n-api.service[61068]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1827866213-project-member Apr 18 17:52:16 user devstack@n-api.service[61068]: method: Apr 18 17:52:16 user devstack@n-api.service[61068]: exception: Volume e54eb773-bbc4-4272-af22-3daa05b8eaed could not be found. Apr 18 17:52:16 user devstack@n-api.service[61068]: action_args: {'id': 'e54eb773-bbc4-4272-af22-3daa05b8eaed'} Apr 18 17:52:16 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e54eb773-bbc4-4272-af22-3daa05b8eaed could not be found. (HTTP 404) (Request-ID: req-92a23711-87b6-43f4-8102-f70caab1778f) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e54eb773-bbc4-4272-af22-3daa05b8eaed could not be found. Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e54eb773-bbc4-4272-af22-3daa05b8eaed could not be found. Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e54eb773-bbc4-4272-af22-3daa05b8eaed could not be found. Apr 18 17:52:16 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:16 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-bd4cd0ae-6cf2-4cb0-9bd2-344208cd2368 tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] Returning 404 to user: Volume e54eb773-bbc4-4272-af22-3daa05b8eaed could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:52:16 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-bd4cd0ae-6cf2-4cb0-9bd2-344208cd2368 tempest-VolumesSnapshotsTestJSON-1827866213 tempest-VolumesSnapshotsTestJSON-1827866213-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed" status: 404 len: 109 microversion: 2.1 time: 0.089602 Apr 18 17:52:16 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 17:52:15 2023] GET /compute/v2.1/os-volumes/e54eb773-bbc4-4272-af22-3daa05b8eaed => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-0b409e12-a852-408e-aa80-be190198fcd4 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Action: 'create', calling method: .version_select at 0x7fb35bfead40>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1604222249", "metadata": {"Type": "work"}}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-0b409e12-a852-408e-aa80-be190198fcd4 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Request method failure captured: Apr 18 17:52:21 user devstack@n-api.service[61069]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 17:52:21 user devstack@n-api.service[61069]: Accept: application/json Apr 18 17:52:21 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 17:52:21 user devstack@n-api.service[61069]: Connection: close Apr 18 17:52:21 user devstack@n-api.service[61069]: Content-Length: 122 Apr 18 17:52:21 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 17:52:21 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 17:52:21 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 17:52:21 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtjVtIcWQE4KckYr1aFJLdjiExWW_9W3SPRQzZaWdlbmJ25l8L97BEA2ym-NwYdiKA-isRm9D_pc0liEeumuDGXbecVG4XDfb2pC-7KCgZbreVEreIoATj_seDWiBM_21t1WYiTOZZxjHNqvYaVQBnY-EZq5l3Zluo9OqweZFKFDUPE Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Id: 536182bc0dd5470796d5e87f94bc609f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Name: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61069]: Apr 18 17:52:21 user devstack@n-api.service[61069]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1604222249", "metadata": {"Type": "work"}}} Apr 18 17:52:21 user devstack@n-api.service[61069]: method: Apr 18 17:52:21 user devstack@n-api.service[61069]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61069]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1604222249', 'metadata': {'Type': 'work'}}}} Apr 18 17:52:21 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise error Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-0b409e12-a852-408e-aa80-be190198fcd4 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:52:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-0b409e12-a852-408e-aa80-be190198fcd4 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.284499 Apr 18 17:52:21 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 17:52:21 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-56983259-a32b-40e2-907a-7f3cc30ba6d2 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Action: 'create', calling method: .version_select at 0x7fb35be04790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1014471842", "metadata": {"Type": "work"}}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-56983259-a32b-40e2-907a-7f3cc30ba6d2 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Request method failure captured: Apr 18 17:52:21 user devstack@n-api.service[61070]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 17:52:21 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:52:21 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:52:21 user devstack@n-api.service[61070]: Connection: close Apr 18 17:52:21 user devstack@n-api.service[61070]: Content-Length: 120 Apr 18 17:52:21 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:52:21 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:52:21 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:52:21 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtjVtIcWQE4KckYr1aFJLdjiExWW_9W3SPRQzZaWdlbmJ25l8L97BEA2ym-NwYdiKA-isRm9D_pc0liEeumuDGXbecVG4XDfb2pC-7KCgZbreVEreIoATj_seDWiBM_21t1WYiTOZZxjHNqvYaVQBnY-EZq5l3Zluo9OqweZFKFDUPE Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Project-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Project-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Tenant: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Tenant-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61070]: X-User: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61070]: X-User-Id: 536182bc0dd5470796d5e87f94bc609f Apr 18 17:52:21 user devstack@n-api.service[61070]: X-User-Name: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61070]: Apr 18 17:52:21 user devstack@n-api.service[61070]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1014471842", "metadata": {"Type": "work"}}} Apr 18 17:52:21 user devstack@n-api.service[61070]: method: Apr 18 17:52:21 user devstack@n-api.service[61070]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 17:52:21 user devstack@n-api.service[61070]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1014471842', 'metadata': {'Type': 'work'}}}} Apr 18 17:52:21 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise error Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi '0' Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 17:52:21 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-56983259-a32b-40e2-907a-7f3cc30ba6d2 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:52:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-56983259-a32b-40e2-907a-7f3cc30ba6d2 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015901 Apr 18 17:52:21 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 17:52:21 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-a80d5d09-8b0c-4999-ad3f-d9313b6016a6 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Action: 'create', calling method: .version_select at 0x7fb35bef4700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1818766466", "metadata": {"Type": "work"}}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-a80d5d09-8b0c-4999-ad3f-d9313b6016a6 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Request method failure captured: Apr 18 17:52:21 user devstack@n-api.service[61068]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 17:52:21 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:52:21 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:52:21 user devstack@n-api.service[61068]: Connection: close Apr 18 17:52:21 user devstack@n-api.service[61068]: Content-Length: 119 Apr 18 17:52:21 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:52:21 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:52:21 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:52:21 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjVtIcWQE4KckYr1aFJLdjiExWW_9W3SPRQzZaWdlbmJ25l8L97BEA2ym-NwYdiKA-isRm9D_pc0liEeumuDGXbecVG4XDfb2pC-7KCgZbreVEreIoATj_seDWiBM_21t1WYiTOZZxjHNqvYaVQBnY-EZq5l3Zluo9OqweZFKFDUPE Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Project-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Project-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Tenant: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Tenant-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61068]: X-User: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61068]: X-User-Id: 536182bc0dd5470796d5e87f94bc609f Apr 18 17:52:21 user devstack@n-api.service[61068]: X-User-Name: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61068]: Apr 18 17:52:21 user devstack@n-api.service[61068]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1818766466", "metadata": {"Type": "work"}}} Apr 18 17:52:21 user devstack@n-api.service[61068]: method: Apr 18 17:52:21 user devstack@n-api.service[61068]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61068]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1818766466', 'metadata': {'Type': 'work'}}}} Apr 18 17:52:21 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise error Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi '' Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 17:52:21 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-a80d5d09-8b0c-4999-ad3f-d9313b6016a6 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:52:21 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-a80d5d09-8b0c-4999-ad3f-d9313b6016a6 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018724 Apr 18 17:52:21 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 19/53] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 17:52:21 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-8e742d6e-7487-45c5-b1af-f14952c291eb tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Calling method '.version_select at 0x7fb35c98d2d0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-8e742d6e-7487-45c5-b1af-f14952c291eb tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] HTTP exception thrown: Volume tempest-invalid-612841455 could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-8e742d6e-7487-45c5-b1af-f14952c291eb tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Request method failure captured: Apr 18 17:52:21 user devstack@n-api.service[61069]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-612841455 HTTP/1.1 Apr 18 17:52:21 user devstack@n-api.service[61069]: Accept: application/json Apr 18 17:52:21 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 17:52:21 user devstack@n-api.service[61069]: Connection: close Apr 18 17:52:21 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 17:52:21 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 17:52:21 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 17:52:21 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 17:52:21 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtjVtIcWQE4KckYr1aFJLdjiExWW_9W3SPRQzZaWdlbmJ25l8L97BEA2ym-NwYdiKA-isRm9D_pc0liEeumuDGXbecVG4XDfb2pC-7KCgZbreVEreIoATj_seDWiBM_21t1WYiTOZZxjHNqvYaVQBnY-EZq5l3Zluo9OqweZFKFDUPE Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Id: 536182bc0dd5470796d5e87f94bc609f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Name: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61069]: method: Apr 18 17:52:21 user devstack@n-api.service[61069]: exception: Volume tempest-invalid-612841455 could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: action_args: {'id': 'tempest-invalid-612841455'} Apr 18 17:52:21 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-612841455 could not be found. (HTTP 404) (Request-ID: req-a6ab1463-0e4b-4c41-9f70-8b154640e3ef) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-612841455 could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-612841455 could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-612841455 could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-8e742d6e-7487-45c5-b1af-f14952c291eb tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Returning 404 to user: Volume tempest-invalid-612841455 could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:52:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-8e742d6e-7487-45c5-b1af-f14952c291eb tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-612841455" status: 404 len: 98 microversion: 2.1 time: 0.047584 Apr 18 17:52:21 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 17:52:21 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-612841455 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-a006fd8a-4f30-4c31-bde6-1ebecffe8021 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008443 Apr 18 17:52:21 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 17:52:21 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-d35738a5-6508-4002-a8ac-1aa2b696ba23 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008408 Apr 18 17:52:21 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 17:52:21 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2f997caf-a91f-417a-b2bf-580f9fce2463 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Calling method '.version_select at 0x7fb35be25120>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-2f997caf-a91f-417a-b2bf-580f9fce2463 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] HTTP exception thrown: Volume 0281f0a9-0dc8-438f-96aa-ac6d92e2f30d could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2f997caf-a91f-417a-b2bf-580f9fce2463 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Request method failure captured: Apr 18 17:52:21 user devstack@n-api.service[61069]: request: DELETE /compute/v2.1/os-volumes/0281f0a9-0dc8-438f-96aa-ac6d92e2f30d HTTP/1.1 Apr 18 17:52:21 user devstack@n-api.service[61069]: Accept: application/json Apr 18 17:52:21 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 17:52:21 user devstack@n-api.service[61069]: Connection: close Apr 18 17:52:21 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 17:52:21 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 17:52:21 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 17:52:21 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 17:52:21 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtjVtIcWQE4KckYr1aFJLdjiExWW_9W3SPRQzZaWdlbmJ25l8L97BEA2ym-NwYdiKA-isRm9D_pc0liEeumuDGXbecVG4XDfb2pC-7KCgZbreVEreIoATj_seDWiBM_21t1WYiTOZZxjHNqvYaVQBnY-EZq5l3Zluo9OqweZFKFDUPE Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Project-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Id: 536182bc0dd5470796d5e87f94bc609f Apr 18 17:52:21 user devstack@n-api.service[61069]: X-User-Name: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:21 user devstack@n-api.service[61069]: method: Apr 18 17:52:21 user devstack@n-api.service[61069]: exception: Volume 0281f0a9-0dc8-438f-96aa-ac6d92e2f30d could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: action_args: {'id': '0281f0a9-0dc8-438f-96aa-ac6d92e2f30d'} Apr 18 17:52:21 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0281f0a9-0dc8-438f-96aa-ac6d92e2f30d could not be found. (HTTP 404) (Request-ID: req-1dbb70a8-8ece-4f7b-bdd8-fb549094d6f2) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0281f0a9-0dc8-438f-96aa-ac6d92e2f30d could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0281f0a9-0dc8-438f-96aa-ac6d92e2f30d could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0281f0a9-0dc8-438f-96aa-ac6d92e2f30d could not be found. Apr 18 17:52:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:52:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2f997caf-a91f-417a-b2bf-580f9fce2463 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Returning 404 to user: Volume 0281f0a9-0dc8-438f-96aa-ac6d92e2f30d could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:52:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-2f997caf-a91f-417a-b2bf-580f9fce2463 tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/0281f0a9-0dc8-438f-96aa-ac6d92e2f30d" status: 404 len: 109 microversion: 2.1 time: 0.042884 Apr 18 17:52:21 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 17:52:21 2023] DELETE /compute/v2.1/os-volumes/0281f0a9-0dc8-438f-96aa-ac6d92e2f30d => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:52:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-1a6ca5f2-574c-4ef5-9a69-4ef85d4b682b tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Calling method '.version_select at 0x7fb35be05ea0>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:22 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-1a6ca5f2-574c-4ef5-9a69-4ef85d4b682b tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] HTTP exception thrown: Volume c82e00b8-7acb-42e7-b939-6d8cf79e1a58 could not be found. Apr 18 17:52:22 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-1a6ca5f2-574c-4ef5-9a69-4ef85d4b682b tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Request method failure captured: Apr 18 17:52:22 user devstack@n-api.service[61070]: request: GET /compute/v2.1/os-volumes/c82e00b8-7acb-42e7-b939-6d8cf79e1a58 HTTP/1.1 Apr 18 17:52:22 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:52:22 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:52:22 user devstack@n-api.service[61070]: Connection: close Apr 18 17:52:22 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 17:52:22 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:52:22 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:52:22 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:52:22 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtjVtIcWQE4KckYr1aFJLdjiExWW_9W3SPRQzZaWdlbmJ25l8L97BEA2ym-NwYdiKA-isRm9D_pc0liEeumuDGXbecVG4XDfb2pC-7KCgZbreVEreIoATj_seDWiBM_21t1WYiTOZZxjHNqvYaVQBnY-EZq5l3Zluo9OqweZFKFDUPE Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Project-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Project-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/652b252c187b4408bef0c9629e71cc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Tenant: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Tenant-Id: 652b252c187b4408bef0c9629e71cc4f Apr 18 17:52:22 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-VolumesNegativeTest-1037411267 Apr 18 17:52:22 user devstack@n-api.service[61070]: X-User: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:22 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:52:22 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:52:22 user devstack@n-api.service[61070]: X-User-Id: 536182bc0dd5470796d5e87f94bc609f Apr 18 17:52:22 user devstack@n-api.service[61070]: X-User-Name: tempest-VolumesNegativeTest-1037411267-project-member Apr 18 17:52:22 user devstack@n-api.service[61070]: method: Apr 18 17:52:22 user devstack@n-api.service[61070]: exception: Volume c82e00b8-7acb-42e7-b939-6d8cf79e1a58 could not be found. Apr 18 17:52:22 user devstack@n-api.service[61070]: action_args: {'id': 'c82e00b8-7acb-42e7-b939-6d8cf79e1a58'} Apr 18 17:52:22 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c82e00b8-7acb-42e7-b939-6d8cf79e1a58 could not be found. (HTTP 404) (Request-ID: req-277b9ebf-d434-4fc0-9d7f-1717c29edcb3) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c82e00b8-7acb-42e7-b939-6d8cf79e1a58 could not be found. Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c82e00b8-7acb-42e7-b939-6d8cf79e1a58 could not be found. Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c82e00b8-7acb-42e7-b939-6d8cf79e1a58 could not be found. Apr 18 17:52:22 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:52:22 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-1a6ca5f2-574c-4ef5-9a69-4ef85d4b682b tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] Returning 404 to user: Volume c82e00b8-7acb-42e7-b939-6d8cf79e1a58 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:52:22 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-1a6ca5f2-574c-4ef5-9a69-4ef85d4b682b tempest-VolumesNegativeTest-1037411267 tempest-VolumesNegativeTest-1037411267-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c82e00b8-7acb-42e7-b939-6d8cf79e1a58" status: 404 len: 109 microversion: 2.1 time: 0.281652 Apr 18 17:52:22 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 17:52:21 2023] GET /compute/v2.1/os-volumes/c82e00b8-7acb-42e7-b939-6d8cf79e1a58 => generated 109 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:52:30 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1821350949", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "92a3fc19-c274-44eb-bd9d-958fdef4a359"}]}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:30 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] validate_networks() for [('92a3fc19-c274-44eb-bd9d-958fdef4a359', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for user 171127a60a304629949304db406a8f5b and project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:52:33 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:52:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-3f6ae159-daf1-4130-87e9-1cf8c1858fbb tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.902135 Apr 18 17:52:33 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 21/59] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 17:52:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 2903 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 17:52:33 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-9db5e770-7317-4493-acbb-44c0c34774cf tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:33 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-9db5e770-7317-4493-acbb-44c0c34774cf tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:52:33 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-9db5e770-7317-4493-acbb-44c0c34774cf tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:33 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-9db5e770-7317-4493-acbb-44c0c34774cf tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:33 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-9db5e770-7317-4493-acbb-44c0c34774cf tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:33 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-9db5e770-7317-4493-acbb-44c0c34774cf tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929" status: 200 len: 1395 microversion: 2.87 time: 0.220468 Apr 18 17:52:33 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:52:33 2023] GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929 => generated 1395 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:52:36 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9db58749-b578-4e2e-906f-eafa9a97052b tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Action: 'create', calling method: .version_select at 0x7fb35c98d000>, body: {"keypair": {"name": "tempest-keypair-1117431546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXzg4p1fdFU53eXi+WZukhnkTCtnQrU+QbKUEn8bZLNU9SxoOqfvXNuHMMZ+dFduzJ49mD1cAztieZaGXebs/SdINFarPARbVgz3zqy9oAFbbq6SCmH3i/QM0zQOsVPhg=="}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:36 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-9db58749-b578-4e2e-906f-eafa9a97052b tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Getting quotas for project 23950807b16a4c73b86650e4529a0156. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:36 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-9db58749-b578-4e2e-906f-eafa9a97052b tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Getting quotas for user 1d327cd807144e3488b8a7dc33c0b740 and project 23950807b16a4c73b86650e4529a0156. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:36 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-9db58749-b578-4e2e-906f-eafa9a97052b tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.374679 Apr 18 17:52:36 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:52:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:38 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1840053363", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:38 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] validate_networks() for [('26dc1b1b-d896-4cda-8bb2-cfdfe50b3b5b', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:52:39 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-3297bb9b-17ae-4475-9422-0d887ac77e75 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Action: 'create', calling method: .version_select at 0x7fb35be26ef0>, body: {"keypair": {"name": "tempest-keypair-1346673688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGeHStYM4ygIuODWJ+8kTcQMPVdBEZD6+MimB+v0jGVv5OizZPF9fh0HWSy49OL58BKJEtxnzs0/J9tDHGkidju50e/pNOqNyiR8hiau6b1sKmy+U030yBv6W1n7KOpFg=="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:39 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-3297bb9b-17ae-4475-9422-0d887ac77e75 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Getting quotas for project 3253cf1033424d3dbbfc38e50ede4d42. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:39 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-3297bb9b-17ae-4475-9422-0d887ac77e75 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Getting quotas for user b4904c9727144ebdaa5ddfd6059f5374 and project 3253cf1033424d3dbbfc38e50ede4d42. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:39 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-3297bb9b-17ae-4475-9422-0d887ac77e75 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.208813 Apr 18 17:52:39 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:52:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:39 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-274356227", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "803d4456-6348-4418-868d-66100bcac857"}]}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:39 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] validate_networks() for [('803d4456-6348-4418-868d-66100bcac857', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-5ef0db29-55e4-44d5-9c5a-1b773eac47f0 req-3e382434-8ed3-400e-856e-fd2ade7d7e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d63901e-b9bf-4c51-b663-5399b7371929", "tag": "c229b851-1edf-4ce4-bfa6-ec1370661073"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5ef0db29-55e4-44d5-9c5a-1b773eac47f0 req-3e382434-8ed3-400e-856e-fd2ade7d7e9d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5ef0db29-55e4-44d5-9c5a-1b773eac47f0 req-3e382434-8ed3-400e-856e-fd2ade7d7e9d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5ef0db29-55e4-44d5-9c5a-1b773eac47f0 req-3e382434-8ed3-400e-856e-fd2ade7d7e9d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:41 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-5ef0db29-55e4-44d5-9c5a-1b773eac47f0 req-3e382434-8ed3-400e-856e-fd2ade7d7e9d service nova] Creating event network-changed:c229b851-1edf-4ce4-bfa6-ec1370661073 for instance 3d63901e-b9bf-4c51-b663-5399b7371929 on user Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5ef0db29-55e4-44d5-9c5a-1b773eac47f0 req-3e382434-8ed3-400e-856e-fd2ade7d7e9d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61069) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5ef0db29-55e4-44d5-9c5a-1b773eac47f0 req-3e382434-8ed3-400e-856e-fd2ade7d7e9d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61069) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:41 user devstack@n-api.service[61069]: INFO nova.compute.rpcapi [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] Releasing lock "compute-rpcapi-router" {{(pid=61069) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 17:52:41 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-c1bd6a70-adc7-4d98-b060-127bbba4aaca None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156103 Apr 18 17:52:41 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 22/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Getting quotas for project 1c689d1535d74fb98276764e48bae128. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Getting quotas for user eae8860750104207a580da9d4020e31e and project 1c689d1535d74fb98276764e48bae128. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: d60955fa-c17f-4588-8348-2b8f5991564d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:52:41 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-552134a5-7d9b-4209-8c73-9a7a150e9dbb tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.983179 Apr 18 17:52:41 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 22/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:52:38 2023] POST /compute/v2.1/servers => generated 381 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-6f452b80-ea6d-4380-abec-d051bb3d2557 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-6f452b80-ea6d-4380-abec-d051bb3d2557 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: d60955fa-c17f-4588-8348-2b8f5991564d] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-6f452b80-ea6d-4380-abec-d051bb3d2557 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:41 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-6f452b80-ea6d-4380-abec-d051bb3d2557 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d" status: 200 len: 1216 microversion: 2.1 time: 0.149896 Apr 18 17:52:41 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:52:41 2023] GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-919101931", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-633d9709-29ae-4f8d-823c-3d147240a62d tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Action: 'create', calling method: .version_select at 0x7fb35bdc2b00>, body: {"keypair": {"name": "tempest-keypair-1368966076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTxYHHc/timtEKjaHkBDf99bUNavJSAoRZgmyGcULDdizDvgU2liZvCxY158eCSSRV/uyY+YpA+XWOLzxg9YhMJnnnw+IDipgTOqA01WU7XyY6H76Idol2wmbPGOOtV9g=="}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-633d9709-29ae-4f8d-823c-3d147240a62d tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Getting quotas for project ecd89586cda04a249c938937bff52645. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:41 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-633d9709-29ae-4f8d-823c-3d147240a62d tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Getting quotas for user 5530d6dd1b104cd7824717aea8f429cf and project ecd89586cda04a249c938937bff52645. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:41 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-633d9709-29ae-4f8d-823c-3d147240a62d tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168136 Apr 18 17:52:41 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 23/66] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:52:41 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:41 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] validate_networks() for [('26dc1b1b-d896-4cda-8bb2-cfdfe50b3b5b', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Getting quotas for project 2d34c960d697434cbe8e088fe7a22ee2. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Getting quotas for user 1c3485d9c96e4c24af53b5e0087b2197 and project 2d34c960d697434cbe8e088fe7a22ee2. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:52:42 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] [instance: c576557f-02b5-4618-af9e-5cd2865db8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:52:42 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-31630184-31b8-4c87-8c80-709050fe129f tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.881944 Apr 18 17:52:42 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 21/67] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:52:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 2893 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:52:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3ac48e81-d4fc-411b-9d99-100107f698a3 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:42 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-3ac48e81-d4fc-411b-9d99-100107f698a3 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] [instance: c576557f-02b5-4618-af9e-5cd2865db8b2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:52:42 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-3ac48e81-d4fc-411b-9d99-100107f698a3 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3485d9c96e4c24af53b5e0087b2197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d34c960d697434cbe8e088fe7a22ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-3ac48e81-d4fc-411b-9d99-100107f698a3 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2" status: 200 len: 1208 microversion: 2.1 time: 0.216807 Apr 18 17:52:42 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 24/68] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:52:42 2023] GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2 => generated 1208 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:52:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-960891457", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "c9be63b1-b18e-401b-bf05-0f87c6f8dc46"}], "security_groups": [{"name": "tempest-securitygroup--675941978"}], "key_name": "tempest-keypair-1117431546", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:43 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] validate_networks() for [('c9be63b1-b18e-401b-bf05-0f87c6f8dc46', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Getting quotas for project 1c689d1535d74fb98276764e48bae128. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Getting quotas for user eae8860750104207a580da9d4020e31e and project 1c689d1535d74fb98276764e48bae128. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:52:44 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:52:44 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-1de25525-6591-4430-a361-030cfe7978b7 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.483446 Apr 18 17:52:44 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 24/69] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:52:41 2023] POST /compute/v2.1/servers => generated 381 bytes in 2485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:52:44 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-54bafea4-133d-4bc1-adc2-d30a5f207ac6 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:44 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-54bafea4-133d-4bc1-adc2-d30a5f207ac6 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:52:44 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-54bafea4-133d-4bc1-adc2-d30a5f207ac6 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-54bafea4-133d-4bc1-adc2-d30a5f207ac6 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe" status: 200 len: 1215 microversion: 2.1 time: 0.186203 Apr 18 17:52:44 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 25/70] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:52:44 2023] GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:52:45 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-603992942", "imageRef": "0cd6f38e-0e6f-4309-acc3-535d78fb6967", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "19330178-a306-416f-aa8e-b08cfa6c42c4"}], "security_groups": [{"name": "tempest-securitygroup--102306535"}], "key_name": "tempest-keypair-1346673688", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Getting quotas for project 23950807b16a4c73b86650e4529a0156. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Getting quotas for user 1d327cd807144e3488b8a7dc33c0b740 and project 23950807b16a4c73b86650e4529a0156. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:52:45 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:52:45 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] validate_networks() for [('19330178-a306-416f-aa8e-b08cfa6c42c4', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:52:45 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-f348cb56-97a7-4cfb-b504-784c89b20b5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.736475 Apr 18 17:52:45 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 22/71] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:52:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:52:45 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-c10a0bbd-a192-4922-b84a-e781dbe6c2a3 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:45 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-c10a0bbd-a192-4922-b84a-e781dbe6c2a3 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:52:46 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-c10a0bbd-a192-4922-b84a-e781dbe6c2a3 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d327cd807144e3488b8a7dc33c0b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23950807b16a4c73b86650e4529a0156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:46 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-c10a0bbd-a192-4922-b84a-e781dbe6c2a3 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7" status: 200 len: 1239 microversion: 2.1 time: 0.279044 Apr 18 17:52:46 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 26/72] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:52:45 2023] GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 => generated 1239 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-5fc99e02-6533-4825-ac04-f69706f944e2 req-5be3e056-83bc-4e52-94cd-b97576235369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d63901e-b9bf-4c51-b663-5399b7371929", "name": "network-vif-plugged", "status": "completed", "tag": "c229b851-1edf-4ce4-bfa6-ec1370661073"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5fc99e02-6533-4825-ac04-f69706f944e2 req-5be3e056-83bc-4e52-94cd-b97576235369 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5fc99e02-6533-4825-ac04-f69706f944e2 req-5be3e056-83bc-4e52-94cd-b97576235369 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5fc99e02-6533-4825-ac04-f69706f944e2 req-5be3e056-83bc-4e52-94cd-b97576235369 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:47 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-5fc99e02-6533-4825-ac04-f69706f944e2 req-5be3e056-83bc-4e52-94cd-b97576235369 service nova] Creating event network-vif-plugged:c229b851-1edf-4ce4-bfa6-ec1370661073 for instance 3d63901e-b9bf-4c51-b663-5399b7371929 on user Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5fc99e02-6533-4825-ac04-f69706f944e2 req-5be3e056-83bc-4e52-94cd-b97576235369 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61070) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5fc99e02-6533-4825-ac04-f69706f944e2 req-5be3e056-83bc-4e52-94cd-b97576235369 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61070) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:47 user devstack@n-api.service[61070]: INFO nova.compute.rpcapi [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 17:52:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] Releasing lock "compute-rpcapi-router" {{(pid=61070) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:47 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-0a7d2b38-82fe-4828-8d34-95e45b05a27f None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217927 Apr 18 17:52:47 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 23/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Getting quotas for project 3253cf1033424d3dbbfc38e50ede4d42. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Getting quotas for user b4904c9727144ebdaa5ddfd6059f5374 and project 3253cf1033424d3dbbfc38e50ede4d42. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:52:47 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0cd6f38e-0e6f-4309-acc3-535d78fb6967',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:52:47 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-9ed28293-64d3-4bd0-ae2d-6b8b55a63f43 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.493131 Apr 18 17:52:47 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 25/74] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:52:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:52:48 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-17e54b97-1874-4aa0-ab78-04a6059c4cf3 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:48 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-17e54b97-1874-4aa0-ab78-04a6059c4cf3 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:52:48 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-17e54b97-1874-4aa0-ab78-04a6059c4cf3 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4904c9727144ebdaa5ddfd6059f5374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3253cf1033424d3dbbfc38e50ede4d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:48 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-17e54b97-1874-4aa0-ab78-04a6059c4cf3 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078" status: 200 len: 1239 microversion: 2.1 time: 0.310568 Apr 18 17:52:48 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 27/75] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:52:47 2023] GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 => generated 1239 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:52:49 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-ab10aaed-5d2f-43ea-b263-056328a1d5fd req-398b97e9-aba5-436c-9e7b-33165d40bc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d63901e-b9bf-4c51-b663-5399b7371929", "name": "network-vif-plugged", "status": "completed", "tag": "c229b851-1edf-4ce4-bfa6-ec1370661073"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:49 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ab10aaed-5d2f-43ea-b263-056328a1d5fd req-398b97e9-aba5-436c-9e7b-33165d40bc5c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:49 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ab10aaed-5d2f-43ea-b263-056328a1d5fd req-398b97e9-aba5-436c-9e7b-33165d40bc5c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:49 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ab10aaed-5d2f-43ea-b263-056328a1d5fd req-398b97e9-aba5-436c-9e7b-33165d40bc5c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:49 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-ab10aaed-5d2f-43ea-b263-056328a1d5fd req-398b97e9-aba5-436c-9e7b-33165d40bc5c service nova] Creating event network-vif-plugged:c229b851-1edf-4ce4-bfa6-ec1370661073 for instance 3d63901e-b9bf-4c51-b663-5399b7371929 on user Apr 18 17:52:49 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-ab10aaed-5d2f-43ea-b263-056328a1d5fd req-398b97e9-aba5-436c-9e7b-33165d40bc5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038458 Apr 18 17:52:49 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 24/76] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:50 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-3cc4ed40-858e-40ca-88c5-0a8bfa23a0f9 req-b21b6e91-f58f-4f44-b443-c9e1d2117716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:50 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-3cc4ed40-858e-40ca-88c5-0a8bfa23a0f9 req-b21b6e91-f58f-4f44-b443-c9e1d2117716 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:50 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-3cc4ed40-858e-40ca-88c5-0a8bfa23a0f9 req-b21b6e91-f58f-4f44-b443-c9e1d2117716 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:50 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-3cc4ed40-858e-40ca-88c5-0a8bfa23a0f9 req-b21b6e91-f58f-4f44-b443-c9e1d2117716 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-3cc4ed40-858e-40ca-88c5-0a8bfa23a0f9 req-b21b6e91-f58f-4f44-b443-c9e1d2117716 service nova] Creating event network-changed:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:52:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-3cc4ed40-858e-40ca-88c5-0a8bfa23a0f9 req-b21b6e91-f58f-4f44-b443-c9e1d2117716 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093053 Apr 18 17:52:50 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-36b4f1be-4482-4f90-84f8-c09e5718015a req-a3484f1f-5c1c-4248-bdde-3897366abfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-36b4f1be-4482-4f90-84f8-c09e5718015a req-a3484f1f-5c1c-4248-bdde-3897366abfa4 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-36b4f1be-4482-4f90-84f8-c09e5718015a req-a3484f1f-5c1c-4248-bdde-3897366abfa4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-36b4f1be-4482-4f90-84f8-c09e5718015a req-a3484f1f-5c1c-4248-bdde-3897366abfa4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:50 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-36b4f1be-4482-4f90-84f8-c09e5718015a req-a3484f1f-5c1c-4248-bdde-3897366abfa4 service nova] Creating event network-changed:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-36b4f1be-4482-4f90-84f8-c09e5718015a req-a3484f1f-5c1c-4248-bdde-3897366abfa4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61068) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-36b4f1be-4482-4f90-84f8-c09e5718015a req-a3484f1f-5c1c-4248-bdde-3897366abfa4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61068) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:50 user devstack@n-api.service[61068]: INFO nova.compute.rpcapi [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 17:52:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] Releasing lock "compute-rpcapi-router" {{(pid=61068) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 17:52:50 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-21ffb585-ee24-4cdc-8b85-2e442e499b1a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244879 Apr 18 17:52:50 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 28/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:50 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1477718106", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c9f56de5-3204-4ebd-a64c-ad91e36e6cac"}], "security_groups": [{"name": "tempest-securitygroup--821005766"}], "key_name": "tempest-keypair-1368966076", "user_data": "}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:51 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] validate_networks() for [('c9f56de5-3204-4ebd-a64c-ad91e36e6cac', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:52:52 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-021e0bef-fd92-4614-a7c3-bbb84f19f9f8 req-55505c75-97c6-40bb-a108-88fc505f97e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c576557f-02b5-4618-af9e-5cd2865db8b2", "tag": "f22acb06-0c4f-4cd5-88c4-190f1437c7dc"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:52 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-021e0bef-fd92-4614-a7c3-bbb84f19f9f8 req-55505c75-97c6-40bb-a108-88fc505f97e9 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:52 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-021e0bef-fd92-4614-a7c3-bbb84f19f9f8 req-55505c75-97c6-40bb-a108-88fc505f97e9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:52 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-021e0bef-fd92-4614-a7c3-bbb84f19f9f8 req-55505c75-97c6-40bb-a108-88fc505f97e9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:52 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-021e0bef-fd92-4614-a7c3-bbb84f19f9f8 req-55505c75-97c6-40bb-a108-88fc505f97e9 service nova] Creating event network-changed:f22acb06-0c4f-4cd5-88c4-190f1437c7dc for instance c576557f-02b5-4618-af9e-5cd2865db8b2 on user Apr 18 17:52:52 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-021e0bef-fd92-4614-a7c3-bbb84f19f9f8 req-55505c75-97c6-40bb-a108-88fc505f97e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039768 Apr 18 17:52:52 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:53 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-557cc37e-ab21-4a22-abcf-69776b99c242 req-2cca5836-207c-4305-9df8-8c992971c183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02122464-697c-4f0b-907f-30f6be1138f7", "tag": "15734420-8d2f-4a4c-8ecd-360d03fc5825"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:53 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-557cc37e-ab21-4a22-abcf-69776b99c242 req-2cca5836-207c-4305-9df8-8c992971c183 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:53 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-557cc37e-ab21-4a22-abcf-69776b99c242 req-2cca5836-207c-4305-9df8-8c992971c183 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:53 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-557cc37e-ab21-4a22-abcf-69776b99c242 req-2cca5836-207c-4305-9df8-8c992971c183 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:53 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-557cc37e-ab21-4a22-abcf-69776b99c242 req-2cca5836-207c-4305-9df8-8c992971c183 service nova] Creating event network-changed:15734420-8d2f-4a4c-8ecd-360d03fc5825 for instance 02122464-697c-4f0b-907f-30f6be1138f7 on user Apr 18 17:52:53 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-557cc37e-ab21-4a22-abcf-69776b99c242 req-2cca5836-207c-4305-9df8-8c992971c183 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054298 Apr 18 17:52:53 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 29/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Getting quotas for project ecd89586cda04a249c938937bff52645. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Getting quotas for user 5530d6dd1b104cd7824717aea8f429cf and project ecd89586cda04a249c938937bff52645. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:52:54 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:52:54 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-f7fabf91-192e-48b5-a0d0-1196f39ff0f7 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.868213 Apr 18 17:52:54 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 25/81] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:52:50 2023] POST /compute/v2.1/servers => generated 406 bytes in 3870 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:52:54 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-e8a505f0-c8fe-4d96-8c20-aace11492cf5 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:52:54 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-e8a505f0-c8fe-4d96-8c20-aace11492cf5 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:52:54 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-5b7496cc-664c-4bd0-bd05-a3668d86f917 req-6be16eb4-d4a7-40f8-a24f-3210a3eed401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-plugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5b7496cc-664c-4bd0-bd05-a3668d86f917 req-6be16eb4-d4a7-40f8-a24f-3210a3eed401 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5b7496cc-664c-4bd0-bd05-a3668d86f917 req-6be16eb4-d4a7-40f8-a24f-3210a3eed401 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5b7496cc-664c-4bd0-bd05-a3668d86f917 req-6be16eb4-d4a7-40f8-a24f-3210a3eed401 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:54 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5b7496cc-664c-4bd0-bd05-a3668d86f917 req-6be16eb4-d4a7-40f8-a24f-3210a3eed401 service nova] Creating event network-vif-plugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:52:54 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-5b7496cc-664c-4bd0-bd05-a3668d86f917 req-6be16eb4-d4a7-40f8-a24f-3210a3eed401 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047393 Apr 18 17:52:54 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 30/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:54 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-e8a505f0-c8fe-4d96-8c20-aace11492cf5 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:52:54 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-e8a505f0-c8fe-4d96-8c20-aace11492cf5 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1233 microversion: 2.1 time: 0.202730 Apr 18 17:52:54 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:52:54 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1233 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:52:56 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-59cb4fcb-8f94-4b19-b2a5-7090424feee2 req-961643d8-d896-46b5-b24f-344e065c60aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-plugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-59cb4fcb-8f94-4b19-b2a5-7090424feee2 req-961643d8-d896-46b5-b24f-344e065c60aa service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-59cb4fcb-8f94-4b19-b2a5-7090424feee2 req-961643d8-d896-46b5-b24f-344e065c60aa service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-59cb4fcb-8f94-4b19-b2a5-7090424feee2 req-961643d8-d896-46b5-b24f-344e065c60aa service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:56 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-59cb4fcb-8f94-4b19-b2a5-7090424feee2 req-961643d8-d896-46b5-b24f-344e065c60aa service nova] Creating event network-vif-plugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:52:56 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-59cb4fcb-8f94-4b19-b2a5-7090424feee2 req-961643d8-d896-46b5-b24f-344e065c60aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040420 Apr 18 17:52:56 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 26/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:52:59 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=24 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:52:59 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-c51079c8-c297-4bb2-9af4-fcbf3d5e5435 req-67a753dc-7c65-4158-890a-b06411a56e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78732a0-37b0-4c31-8101-a68e40c82078", "tag": "9805f1ed-c55d-4486-b45b-c014901e103b"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:52:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c51079c8-c297-4bb2-9af4-fcbf3d5e5435 req-67a753dc-7c65-4158-890a-b06411a56e3f service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:52:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c51079c8-c297-4bb2-9af4-fcbf3d5e5435 req-67a753dc-7c65-4158-890a-b06411a56e3f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:52:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c51079c8-c297-4bb2-9af4-fcbf3d5e5435 req-67a753dc-7c65-4158-890a-b06411a56e3f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:52:59 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-c51079c8-c297-4bb2-9af4-fcbf3d5e5435 req-67a753dc-7c65-4158-890a-b06411a56e3f service nova] Creating event network-changed:9805f1ed-c55d-4486-b45b-c014901e103b for instance a78732a0-37b0-4c31-8101-a68e40c82078 on user Apr 18 17:52:59 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-c51079c8-c297-4bb2-9af4-fcbf3d5e5435 req-67a753dc-7c65-4158-890a-b06411a56e3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049249 Apr 18 17:52:59 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 31/85] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:52:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:00 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-8f7c7aed-6e4c-495a-992f-ee9ce25e0860 req-ee36bf11-358e-4220-a68c-55e9070b6071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ff41f2-dacf-49c7-8c2e-7621fbca6af2", "tag": "b76c25db-01e7-4cf3-9457-3c7e8ec1db2a"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:00 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:00 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8f7c7aed-6e4c-495a-992f-ee9ce25e0860 req-ee36bf11-358e-4220-a68c-55e9070b6071 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:00 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8f7c7aed-6e4c-495a-992f-ee9ce25e0860 req-ee36bf11-358e-4220-a68c-55e9070b6071 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:00 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8f7c7aed-6e4c-495a-992f-ee9ce25e0860 req-ee36bf11-358e-4220-a68c-55e9070b6071 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:00 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-8f7c7aed-6e4c-495a-992f-ee9ce25e0860 req-ee36bf11-358e-4220-a68c-55e9070b6071 service nova] Creating event network-changed:b76c25db-01e7-4cf3-9457-3c7e8ec1db2a for instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 on user Apr 18 17:53:00 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-8f7c7aed-6e4c-495a-992f-ee9ce25e0860 req-ee36bf11-358e-4220-a68c-55e9070b6071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041572 Apr 18 17:53:00 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:01 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-795fe5ab-10b9-467b-a167-694de3e5f2df req-e432fd32-92a8-45c8-a48c-b10f05b3cd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-plugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}, {"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-plugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-795fe5ab-10b9-467b-a167-694de3e5f2df req-e432fd32-92a8-45c8-a48c-b10f05b3cd39 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-795fe5ab-10b9-467b-a167-694de3e5f2df req-e432fd32-92a8-45c8-a48c-b10f05b3cd39 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-795fe5ab-10b9-467b-a167-694de3e5f2df req-e432fd32-92a8-45c8-a48c-b10f05b3cd39 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-795fe5ab-10b9-467b-a167-694de3e5f2df req-e432fd32-92a8-45c8-a48c-b10f05b3cd39 service nova] Creating event network-vif-plugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:53:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-795fe5ab-10b9-467b-a167-694de3e5f2df req-e432fd32-92a8-45c8-a48c-b10f05b3cd39 service nova] Creating event network-vif-plugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:53:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-795fe5ab-10b9-467b-a167-694de3e5f2df req-e432fd32-92a8-45c8-a48c-b10f05b3cd39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118014 Apr 18 17:53:01 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 27/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:04 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:04 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-ec05e836-d5c5-4075-8fc6-ebcbad44798f tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Action: 'create', calling method: .version_select at 0x7fb35b459b40>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-31044549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVO/Juf8fRJG5In/vTw5mI0THk5UB6k1L2wAZJnpor8U0hLWCR8ZKLwuKyp+XpdvUfU18h0UD70M9RiyLM10fcLhkHY7sO8n1JURupVy3u0qDVbVQSGz4y5kYIHQerG9w=="}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:04 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:04 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-ec05e836-d5c5-4075-8fc6-ebcbad44798f tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Getting quotas for project 32403a8e23024e52bb44376bec5bc645. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:53:04 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-ec05e836-d5c5-4075-8fc6-ebcbad44798f tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Getting quotas for user 4c23c9d2ea01463fb831fb9dfb5971d0 and project 32403a8e23024e52bb44376bec5bc645. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:53:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-ec05e836-d5c5-4075-8fc6-ebcbad44798f tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.695491 Apr 18 17:53:04 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 32/88] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:53:04 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:05 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=22 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:06 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-2649e891-556c-47a6-8695-fc36b066992b req-172743c7-0570-4d14-8c65-f00c462670bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02122464-697c-4f0b-907f-30f6be1138f7", "name": "network-vif-plugged", "status": "completed", "tag": "15734420-8d2f-4a4c-8ecd-360d03fc5825"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:06 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2649e891-556c-47a6-8695-fc36b066992b req-172743c7-0570-4d14-8c65-f00c462670bb service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2649e891-556c-47a6-8695-fc36b066992b req-172743c7-0570-4d14-8c65-f00c462670bb service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2649e891-556c-47a6-8695-fc36b066992b req-172743c7-0570-4d14-8c65-f00c462670bb service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:06 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=15 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:06 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-2649e891-556c-47a6-8695-fc36b066992b req-172743c7-0570-4d14-8c65-f00c462670bb service nova] Creating event network-vif-plugged:15734420-8d2f-4a4c-8ecd-360d03fc5825 for instance 02122464-697c-4f0b-907f-30f6be1138f7 on user Apr 18 17:53:06 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-2649e891-556c-47a6-8695-fc36b066992b req-172743c7-0570-4d14-8c65-f00c462670bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125011 Apr 18 17:53:06 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=8 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=22 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02122464-697c-4f0b-907f-30f6be1138f7", "name": "network-vif-plugged", "status": "completed", "tag": "15734420-8d2f-4a4c-8ecd-360d03fc5825"}, {"server_uuid": "c576557f-02b5-4618-af9e-5cd2865db8b2", "name": "network-vif-plugged", "status": "completed", "tag": "f22acb06-0c4f-4cd5-88c4-190f1437c7dc"}, {"server_uuid": "c576557f-02b5-4618-af9e-5cd2865db8b2", "name": "network-vif-plugged", "status": "completed", "tag": "f22acb06-0c4f-4cd5-88c4-190f1437c7dc"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=10 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:08 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=17 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:08 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] Creating event network-vif-plugged:15734420-8d2f-4a4c-8ecd-360d03fc5825 for instance 02122464-697c-4f0b-907f-30f6be1138f7 on user Apr 18 17:53:08 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] Creating event network-vif-plugged:f22acb06-0c4f-4cd5-88c4-190f1437c7dc for instance c576557f-02b5-4618-af9e-5cd2865db8b2 on user Apr 18 17:53:08 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] Creating event network-vif-plugged:f22acb06-0c4f-4cd5-88c4-190f1437c7dc for instance c576557f-02b5-4618-af9e-5cd2865db8b2 on user Apr 18 17:53:08 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-13210636-ae64-4a5d-941a-ee4c165d49b8 req-efd6a9cb-ba5b-482a-b9c0-5cab0c65f70a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.141466 Apr 18 17:53:08 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 28/90] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:08 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:08 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-272adeb8-46d4-4ab3-9486-90f17f072892 req-8610ad7e-5d86-44f9-9df9-88b48b38e83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78732a0-37b0-4c31-8101-a68e40c82078", "name": "network-vif-plugged", "status": "completed", "tag": "9805f1ed-c55d-4486-b45b-c014901e103b"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-272adeb8-46d4-4ab3-9486-90f17f072892 req-8610ad7e-5d86-44f9-9df9-88b48b38e83d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-272adeb8-46d4-4ab3-9486-90f17f072892 req-8610ad7e-5d86-44f9-9df9-88b48b38e83d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-272adeb8-46d4-4ab3-9486-90f17f072892 req-8610ad7e-5d86-44f9-9df9-88b48b38e83d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:08 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=15 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:08 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-272adeb8-46d4-4ab3-9486-90f17f072892 req-8610ad7e-5d86-44f9-9df9-88b48b38e83d service nova] Creating event network-vif-plugged:9805f1ed-c55d-4486-b45b-c014901e103b for instance a78732a0-37b0-4c31-8101-a68e40c82078 on user Apr 18 17:53:08 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-272adeb8-46d4-4ab3-9486-90f17f072892 req-8610ad7e-5d86-44f9-9df9-88b48b38e83d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044973 Apr 18 17:53:08 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 33/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:10 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-465aad01-e39e-4f9e-b52d-e8357411d044 req-b5a1e009-f8a0-4c25-98fa-a9ba83a914ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ff41f2-dacf-49c7-8c2e-7621fbca6af2", "name": "network-vif-plugged", "status": "completed", "tag": "b76c25db-01e7-4cf3-9457-3c7e8ec1db2a"}, {"server_uuid": "46ff41f2-dacf-49c7-8c2e-7621fbca6af2", "name": "network-vif-plugged", "status": "completed", "tag": "b76c25db-01e7-4cf3-9457-3c7e8ec1db2a"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:10 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-465aad01-e39e-4f9e-b52d-e8357411d044 req-b5a1e009-f8a0-4c25-98fa-a9ba83a914ec service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:10 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-465aad01-e39e-4f9e-b52d-e8357411d044 req-b5a1e009-f8a0-4c25-98fa-a9ba83a914ec service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:10 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-465aad01-e39e-4f9e-b52d-e8357411d044 req-b5a1e009-f8a0-4c25-98fa-a9ba83a914ec service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:10 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-465aad01-e39e-4f9e-b52d-e8357411d044 req-b5a1e009-f8a0-4c25-98fa-a9ba83a914ec service nova] Creating event network-vif-plugged:b76c25db-01e7-4cf3-9457-3c7e8ec1db2a for instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 on user Apr 18 17:53:10 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-465aad01-e39e-4f9e-b52d-e8357411d044 req-b5a1e009-f8a0-4c25-98fa-a9ba83a914ec service nova] Creating event network-vif-plugged:b76c25db-01e7-4cf3-9457-3c7e8ec1db2a for instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 on user Apr 18 17:53:10 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-465aad01-e39e-4f9e-b52d-e8357411d044 req-b5a1e009-f8a0-4c25-98fa-a9ba83a914ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057530 Apr 18 17:53:10 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:10 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-0c233081-2262-4172-bc01-da4b78f6ee56 req-f1f5dbb6-557d-486a-8055-9d059620cf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78732a0-37b0-4c31-8101-a68e40c82078", "name": "network-vif-plugged", "status": "completed", "tag": "9805f1ed-c55d-4486-b45b-c014901e103b"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:10 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0c233081-2262-4172-bc01-da4b78f6ee56 req-f1f5dbb6-557d-486a-8055-9d059620cf25 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:10 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0c233081-2262-4172-bc01-da4b78f6ee56 req-f1f5dbb6-557d-486a-8055-9d059620cf25 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:10 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0c233081-2262-4172-bc01-da4b78f6ee56 req-f1f5dbb6-557d-486a-8055-9d059620cf25 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:10 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-0c233081-2262-4172-bc01-da4b78f6ee56 req-f1f5dbb6-557d-486a-8055-9d059620cf25 service nova] Creating event network-vif-plugged:9805f1ed-c55d-4486-b45b-c014901e103b for instance a78732a0-37b0-4c31-8101-a68e40c82078 on user Apr 18 17:53:10 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-0c233081-2262-4172-bc01-da4b78f6ee56 req-f1f5dbb6-557d-486a-8055-9d059620cf25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056685 Apr 18 17:53:10 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 29/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:11 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-896869714", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-31044549", "security_groups": [{"name": "tempest-secgroup-smoke-1483672104"}], "networks": [{"uuid": "5dbcd905-40a9-423d-bce1-4a06943fc147"}]}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:12 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] validate_networks() for [('5dbcd905-40a9-423d-bce1-4a06943fc147', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Getting quotas for project 32403a8e23024e52bb44376bec5bc645. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Getting quotas for user 4c23c9d2ea01463fb831fb9dfb5971d0 and project 32403a8e23024e52bb44376bec5bc645. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:53:13 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:53:13 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-a0b5cbf7-4ab9-4de1-9fc5-9fc9882cebc7 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.363536 Apr 18 17:53:13 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 34/94] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:53:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:53:13 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2806436c-ac24-4f87-947d-04120345cba5 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:13 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-2806436c-ac24-4f87-947d-04120345cba5 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:13 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-2806436c-ac24-4f87-947d-04120345cba5 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c23c9d2ea01463fb831fb9dfb5971d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32403a8e23024e52bb44376bec5bc645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-2806436c-ac24-4f87-947d-04120345cba5 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c" status: 200 len: 1254 microversion: 2.1 time: 0.186305 Apr 18 17:53:13 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 32/95] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:13 2023] GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c => generated 1254 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:53:18 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-592cfef5-54eb-4d6b-8976-75d0844fc8ef req-a80980a2-cb60-4ab4-a3bb-b59e75f9f89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c48dd69-57ab-4201-b122-dcbb4965419c", "tag": "b7c677f3-0787-4806-87f4-87bc6f393feb"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:18 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-592cfef5-54eb-4d6b-8976-75d0844fc8ef req-a80980a2-cb60-4ab4-a3bb-b59e75f9f89d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:18 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-592cfef5-54eb-4d6b-8976-75d0844fc8ef req-a80980a2-cb60-4ab4-a3bb-b59e75f9f89d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:18 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-592cfef5-54eb-4d6b-8976-75d0844fc8ef req-a80980a2-cb60-4ab4-a3bb-b59e75f9f89d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:18 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-592cfef5-54eb-4d6b-8976-75d0844fc8ef req-a80980a2-cb60-4ab4-a3bb-b59e75f9f89d service nova] Creating event network-changed:b7c677f3-0787-4806-87f4-87bc6f393feb for instance 9c48dd69-57ab-4201-b122-dcbb4965419c on user Apr 18 17:53:18 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-592cfef5-54eb-4d6b-8976-75d0844fc8ef req-a80980a2-cb60-4ab4-a3bb-b59e75f9f89d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047494 Apr 18 17:53:18 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 30/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:19 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-d11cfd83-b39c-4f4a-9bc0-2cbc909cb8c2 tempest-TestShelveInstance-755662447 tempest-TestShelveInstance-755662447-project-member] Action: 'create', calling method: .version_select at 0x7fb35b458ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2100694782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd+C8sr7hQP77EGREETAnreXJMD9zYAM4yCTz8ajbRzNaWVuU6/I0ZZJaVxopEEF8NPHcjozIW8MWOQMSXUw3d6yZ7bCqHgUlipSDODKzEQrpobC+nVzFo5OhWfMwNDkQ=="}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:19 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-d11cfd83-b39c-4f4a-9bc0-2cbc909cb8c2 tempest-TestShelveInstance-755662447 tempest-TestShelveInstance-755662447-project-member] Getting quotas for project 2f84fd3ebad648bfa34ac5bee0906211. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:53:19 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-d11cfd83-b39c-4f4a-9bc0-2cbc909cb8c2 tempest-TestShelveInstance-755662447 tempest-TestShelveInstance-755662447-project-member] Getting quotas for user b2c5686c48cc49f6842beb2e882b6c48 and project 2f84fd3ebad648bfa34ac5bee0906211. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:53:19 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-d11cfd83-b39c-4f4a-9bc0-2cbc909cb8c2 tempest-TestShelveInstance-755662447 tempest-TestShelveInstance-755662447-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.403642 Apr 18 17:53:19 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 35/97] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:53:19 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-2d22357d-bf1a-4edb-bd83-bd0e0bc4b1b2 req-1e2b92ec-4586-4f2c-bbb5-e5cea29f1ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c48dd69-57ab-4201-b122-dcbb4965419c", "name": "network-vif-plugged", "status": "completed", "tag": "b7c677f3-0787-4806-87f4-87bc6f393feb"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:21 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2d22357d-bf1a-4edb-bd83-bd0e0bc4b1b2 req-1e2b92ec-4586-4f2c-bbb5-e5cea29f1ca6 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2d22357d-bf1a-4edb-bd83-bd0e0bc4b1b2 req-1e2b92ec-4586-4f2c-bbb5-e5cea29f1ca6 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2d22357d-bf1a-4edb-bd83-bd0e0bc4b1b2 req-1e2b92ec-4586-4f2c-bbb5-e5cea29f1ca6 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-2d22357d-bf1a-4edb-bd83-bd0e0bc4b1b2 req-1e2b92ec-4586-4f2c-bbb5-e5cea29f1ca6 service nova] Creating event network-vif-plugged:b7c677f3-0787-4806-87f4-87bc6f393feb for instance 9c48dd69-57ab-4201-b122-dcbb4965419c on user Apr 18 17:53:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-2d22357d-bf1a-4edb-bd83-bd0e0bc4b1b2 req-1e2b92ec-4586-4f2c-bbb5-e5cea29f1ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052933 Apr 18 17:53:21 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:23 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-c8d30cbe-735f-499d-a1fc-0f48c354dd58 req-843fa261-be0b-4ed5-a3d4-1f67db1ecb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c48dd69-57ab-4201-b122-dcbb4965419c", "name": "network-vif-plugged", "status": "completed", "tag": "b7c677f3-0787-4806-87f4-87bc6f393feb"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-c8d30cbe-735f-499d-a1fc-0f48c354dd58 req-843fa261-be0b-4ed5-a3d4-1f67db1ecb6d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-c8d30cbe-735f-499d-a1fc-0f48c354dd58 req-843fa261-be0b-4ed5-a3d4-1f67db1ecb6d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-c8d30cbe-735f-499d-a1fc-0f48c354dd58 req-843fa261-be0b-4ed5-a3d4-1f67db1ecb6d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=3 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:23 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-c8d30cbe-735f-499d-a1fc-0f48c354dd58 req-843fa261-be0b-4ed5-a3d4-1f67db1ecb6d service nova] Creating event network-vif-plugged:b7c677f3-0787-4806-87f4-87bc6f393feb for instance 9c48dd69-57ab-4201-b122-dcbb4965419c on user Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:23 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-c8d30cbe-735f-499d-a1fc-0f48c354dd58 req-843fa261-be0b-4ed5-a3d4-1f67db1ecb6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066329 Apr 18 17:53:23 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 31/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:24 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:24 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:24 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:24 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-a0d47155-1253-4b57-827a-73fdc720e648 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929" status: 200 len: 1691 microversion: 2.87 time: 0.671915 Apr 18 17:53:24 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 36/100] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:53:23 2023] GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929 => generated 1691 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:53:25 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:25 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2241863b-9c8a-4ccb-8236-d16a9f82e161 tempest-TestShelveInstance-755662447 tempest-TestShelveInstance-755662447-project-member] Calling method '.version_select at 0x7fb35bd965f0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:25 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-2241863b-9c8a-4ccb-8236-d16a9f82e161 tempest-TestShelveInstance-755662447 tempest-TestShelveInstance-755662447-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2100694782" status: 202 len: 0 microversion: 2.1 time: 0.043834 Apr 18 17:53:25 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 34/101] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 18 17:53:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2100694782 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] [instance: c576557f-02b5-4618-af9e-5cd2865db8b2] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:33 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3485d9c96e4c24af53b5e0087b2197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d34c960d697434cbe8e088fe7a22ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-49125643-e49d-4886-a04a-a4db6ffef109 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2" status: 200 len: 1488 microversion: 2.1 time: 1.065174 Apr 18 17:53:33 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 32/102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:32 2023] GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2 => generated 1488 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=14 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=5 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:35 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:35 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-96d24371-d9cd-4e64-a4e9-98962526b881 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe" status: 200 len: 1503 microversion: 2.1 time: 0.905526 Apr 18 17:53:35 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 37/103] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:34 2023] GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe => generated 1503 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:36 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d327cd807144e3488b8a7dc33c0b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23950807b16a4c73b86650e4529a0156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:36 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-2d3bd67d-81b5-4fc5-b47a-f6a989e64efa tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7" status: 200 len: 1550 microversion: 2.1 time: 0.439278 Apr 18 17:53:36 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 35/104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:36 2023] GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 => generated 1550 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=10 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=14 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:38 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-e46a9b50-636f-4902-9e97-958468ad8fd4 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Action: 'create', calling method: .version_select at 0x7fb35b4f4820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-951182281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNe3YWjJCSoDgpSSd7JGBq4R75tWkzu4GRVn4JFPrki5gRDMCiF/jZ+Voj2wECwJzvFJghRhj6/BAf1jUF19Iw4Vud9NFtj5gW/Ljiem1ew/cq0BBnsn2zainZaExnHZxw=="}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:38 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4904c9727144ebdaa5ddfd6059f5374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3253cf1033424d3dbbfc38e50ede4d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:38 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-be9e0034-25c6-4333-912c-17ca04e160ac tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078" status: 200 len: 1547 microversion: 2.1 time: 0.242710 Apr 18 17:53:38 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 33/105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:38 2023] GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 => generated 1547 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:53:38 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-e46a9b50-636f-4902-9e97-958468ad8fd4 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for project af34eaf8745141928f32aab84e7264b6. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:53:38 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-e46a9b50-636f-4902-9e97-958468ad8fd4 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for user f250508b0762464ebf52fc73f1f49ac8 and project af34eaf8745141928f32aab84e7264b6. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:53:38 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-e46a9b50-636f-4902-9e97-958468ad8fd4 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.043135 Apr 18 17:53:38 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 38/106] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:53:38 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 17:53:38 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1355557534", "imageRef": "b5f29940-00c9-4746-bf7d-c40ba5ba5918", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-951182281", "networks": [{"uuid": "2bd27561-80e1-4278-89f3-4ca5c3a7aa81"}]}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:38 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] validate_networks() for [('2bd27561-80e1-4278-89f3-4ca5c3a7aa81', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for project af34eaf8745141928f32aab84e7264b6. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for user f250508b0762464ebf52fc73f1f49ac8 and project af34eaf8745141928f32aab84e7264b6. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:53:39 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5f29940-00c9-4746-bf7d-c40ba5ba5918',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:53:39 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-fff4bfcc-081b-46ab-b846-8b25d069b237 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.927753 Apr 18 17:53:39 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 36/107] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:53:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 18 17:53:39 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-f87d2a68-e7d1-41bf-88bd-dfa78e6137ed tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:39 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-f87d2a68-e7d1-41bf-88bd-dfa78e6137ed tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:39 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-f87d2a68-e7d1-41bf-88bd-dfa78e6137ed tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:39 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-f87d2a68-e7d1-41bf-88bd-dfa78e6137ed tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f" status: 200 len: 1252 microversion: 2.1 time: 0.077359 Apr 18 17:53:39 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 34/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:39 2023] GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f => generated 1252 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 17:53:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-611069f1-a999-4a4f-89fb-39fd157c582c req-9a0c4d6b-2dc9-4fe4-a0bb-6709119f935a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d51dc75-e26a-4a97-bec1-6a3eba84685f", "tag": "92f00d1e-213d-4aca-b5c4-5ebff96f994e"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-611069f1-a999-4a4f-89fb-39fd157c582c req-9a0c4d6b-2dc9-4fe4-a0bb-6709119f935a service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-611069f1-a999-4a4f-89fb-39fd157c582c req-9a0c4d6b-2dc9-4fe4-a0bb-6709119f935a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-611069f1-a999-4a4f-89fb-39fd157c582c req-9a0c4d6b-2dc9-4fe4-a0bb-6709119f935a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-611069f1-a999-4a4f-89fb-39fd157c582c req-9a0c4d6b-2dc9-4fe4-a0bb-6709119f935a service nova] Creating event network-changed:92f00d1e-213d-4aca-b5c4-5ebff96f994e for instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f on user Apr 18 17:53:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-611069f1-a999-4a4f-89fb-39fd157c582c req-9a0c4d6b-2dc9-4fe4-a0bb-6709119f935a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035637 Apr 18 17:53:42 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 39/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:43 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-dbf92f70-7d6d-4fb4-a079-df7ae053ecbb tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Action: 'create', calling method: .version_select at 0x7fb35b466e60>, body: {"keypair": {"name": "tempest-keypair-1811804517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiI2QVKc2kmfRscPi5PhMnGrOLNQAjOkededwdHp7/Ts7V/on3cNV6O1pmITCaTYJwD6jlXfZCEpUcKmn7pEnGUKWJIChubReN7XtUZZ6F71lOnvH3tE/jU+7CTPtO8Pw=="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:43 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-dbf92f70-7d6d-4fb4-a079-df7ae053ecbb tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Getting quotas for project 84c8ef9ed106494081b51a6bccc144a6. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:53:43 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-dbf92f70-7d6d-4fb4-a079-df7ae053ecbb tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Getting quotas for user 468cf6197f4a4d49b3a58255e999bf9e and project 84c8ef9ed106494081b51a6bccc144a6. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:53:43 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-dbf92f70-7d6d-4fb4-a079-df7ae053ecbb tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.281816 Apr 18 17:53:43 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 37/110] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:53:43 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:45 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-5ebcff25-69e5-4fbc-965c-ccc00092afe6 req-dedbe0b6-9675-4e28-97be-16378caa0ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d51dc75-e26a-4a97-bec1-6a3eba84685f", "name": "network-vif-plugged", "status": "completed", "tag": "92f00d1e-213d-4aca-b5c4-5ebff96f994e"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:45 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5ebcff25-69e5-4fbc-965c-ccc00092afe6 req-dedbe0b6-9675-4e28-97be-16378caa0ccd service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:45 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5ebcff25-69e5-4fbc-965c-ccc00092afe6 req-dedbe0b6-9675-4e28-97be-16378caa0ccd service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:45 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5ebcff25-69e5-4fbc-965c-ccc00092afe6 req-dedbe0b6-9675-4e28-97be-16378caa0ccd service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:45 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5ebcff25-69e5-4fbc-965c-ccc00092afe6 req-dedbe0b6-9675-4e28-97be-16378caa0ccd service nova] Creating event network-vif-plugged:92f00d1e-213d-4aca-b5c4-5ebff96f994e for instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f on user Apr 18 17:53:45 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-5ebcff25-69e5-4fbc-965c-ccc00092afe6 req-dedbe0b6-9675-4e28-97be-16378caa0ccd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038352 Apr 18 17:53:45 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 40/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:45 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:45 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-39a44593-ff52-40d2-ac52-3e383e3b060b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1539 microversion: 2.1 time: 0.418735 Apr 18 17:53:45 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 35/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:44 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1539 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:53:45 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-434953463", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "22d94a93-462a-4392-a96a-21d97b0e7fd1"}], "security_groups": [{"name": "tempest-securitygroup--455007526"}], "key_name": "tempest-keypair-1811804517", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:45 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] validate_networks() for [('22d94a93-462a-4392-a96a-21d97b0e7fd1', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Getting quotas for project 84c8ef9ed106494081b51a6bccc144a6. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Getting quotas for user 468cf6197f4a4d49b3a58255e999bf9e and project 84c8ef9ed106494081b51a6bccc144a6. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:53:46 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:53:46 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-b8af99c6-4ebf-49fd-ab83-cd0ecb67d7a2 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.725239 Apr 18 17:53:46 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 38/113] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:53:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:53:46 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-4472f462-6a39-4acb-a3a3-d02bcc9fd544 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:53:46 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-4472f462-6a39-4acb-a3a3-d02bcc9fd544 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:53:46 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-4472f462-6a39-4acb-a3a3-d02bcc9fd544 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468cf6197f4a4d49b3a58255e999bf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c8ef9ed106494081b51a6bccc144a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:53:46 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-4472f462-6a39-4acb-a3a3-d02bcc9fd544 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969" status: 200 len: 1235 microversion: 2.1 time: 0.061656 Apr 18 17:53:46 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 41/114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:53:46 2023] GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969 => generated 1235 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:53:47 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-10bb5fb4-757c-45ff-965f-a01042a5c741 req-fb4ae484-fc79-45d4-af2c-594eadf49f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d51dc75-e26a-4a97-bec1-6a3eba84685f", "name": "network-vif-plugged", "status": "completed", "tag": "92f00d1e-213d-4aca-b5c4-5ebff96f994e"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-10bb5fb4-757c-45ff-965f-a01042a5c741 req-fb4ae484-fc79-45d4-af2c-594eadf49f9f service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-10bb5fb4-757c-45ff-965f-a01042a5c741 req-fb4ae484-fc79-45d4-af2c-594eadf49f9f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-10bb5fb4-757c-45ff-965f-a01042a5c741 req-fb4ae484-fc79-45d4-af2c-594eadf49f9f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:47 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-10bb5fb4-757c-45ff-965f-a01042a5c741 req-fb4ae484-fc79-45d4-af2c-594eadf49f9f service nova] Creating event network-vif-plugged:92f00d1e-213d-4aca-b5c4-5ebff96f994e for instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f on user Apr 18 17:53:47 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-10bb5fb4-757c-45ff-965f-a01042a5c741 req-fb4ae484-fc79-45d4-af2c-594eadf49f9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031561 Apr 18 17:53:47 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 36/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:49 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-0bc031e6-c46b-480c-b8e4-93cbf9cda7b3 req-5cdaf24d-0bce-4ac7-875d-d0ac91c95ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0bc031e6-c46b-480c-b8e4-93cbf9cda7b3 req-5cdaf24d-0bce-4ac7-875d-d0ac91c95ee2 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0bc031e6-c46b-480c-b8e4-93cbf9cda7b3 req-5cdaf24d-0bce-4ac7-875d-d0ac91c95ee2 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0bc031e6-c46b-480c-b8e4-93cbf9cda7b3 req-5cdaf24d-0bce-4ac7-875d-d0ac91c95ee2 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:49 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-0bc031e6-c46b-480c-b8e4-93cbf9cda7b3 req-5cdaf24d-0bce-4ac7-875d-d0ac91c95ee2 service nova] Creating event network-changed:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:53:49 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-0bc031e6-c46b-480c-b8e4-93cbf9cda7b3 req-5cdaf24d-0bce-4ac7-875d-d0ac91c95ee2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034728 Apr 18 17:53:49 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-5398dab1-91e1-478f-8d5d-cee0c30217d3 req-5f0d31f2-1b56-464a-a023-28565d7b317c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-plugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5398dab1-91e1-478f-8d5d-cee0c30217d3 req-5f0d31f2-1b56-464a-a023-28565d7b317c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5398dab1-91e1-478f-8d5d-cee0c30217d3 req-5f0d31f2-1b56-464a-a023-28565d7b317c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5398dab1-91e1-478f-8d5d-cee0c30217d3 req-5f0d31f2-1b56-464a-a023-28565d7b317c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5398dab1-91e1-478f-8d5d-cee0c30217d3 req-5f0d31f2-1b56-464a-a023-28565d7b317c service nova] Creating event network-vif-plugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:53:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-5398dab1-91e1-478f-8d5d-cee0c30217d3 req-5f0d31f2-1b56-464a-a023-28565d7b317c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047321 Apr 18 17:53:51 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 42/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:53:53 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:53:53 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-5ef964e7-4e26-4838-b32e-226dcc22a924 req-a1ce912b-0d3d-44af-b9d8-20e398668908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-plugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:53:53 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5ef964e7-4e26-4838-b32e-226dcc22a924 req-a1ce912b-0d3d-44af-b9d8-20e398668908 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:53:53 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5ef964e7-4e26-4838-b32e-226dcc22a924 req-a1ce912b-0d3d-44af-b9d8-20e398668908 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:53:53 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5ef964e7-4e26-4838-b32e-226dcc22a924 req-a1ce912b-0d3d-44af-b9d8-20e398668908 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:53:53 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-5ef964e7-4e26-4838-b32e-226dcc22a924 req-a1ce912b-0d3d-44af-b9d8-20e398668908 service nova] Creating event network-vif-plugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:53:53 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-5ef964e7-4e26-4838-b32e-226dcc22a924 req-a1ce912b-0d3d-44af-b9d8-20e398668908 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Apr 18 17:53:53 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 37/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:53:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=4 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=16 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=7 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=12 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:04 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c23c9d2ea01463fb831fb9dfb5971d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32403a8e23024e52bb44376bec5bc645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:04 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-7ed100d5-602f-400d-b587-4d3b04b114c3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c" status: 200 len: 1566 microversion: 2.1 time: 0.620475 Apr 18 17:54:04 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 40/119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:03 2023] GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c => generated 1566 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=12 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1933084262"}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:25 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-2004228d-f3ad-4ead-80d2-a6d42641c749 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929/action" status: 202 len: 52 microversion: 2.87 time: 1.134138 Apr 18 17:54:25 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 43/120] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 17:54:24 2023] POST /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929/action => generated 52 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=11 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=15 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:30 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:30 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-729f92be-74ed-4360-b175-6d35d75d55c7 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f" status: 200 len: 1536 microversion: 2.1 time: 0.225413 Apr 18 17:54:30 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 38/121] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:29 2023] GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f => generated 1536 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:31 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:31 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:31 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:31 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-1e4d827e-f18a-40fe-8d92-d5ddf3a32aa6 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929" status: 200 len: 1691 microversion: 2.87 time: 0.286095 Apr 18 17:54:31 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 41/122] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:54:30 2023] GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929 => generated 1691 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] [instance: c576557f-02b5-4618-af9e-5cd2865db8b2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] [instance: c576557f-02b5-4618-af9e-5cd2865db8b2] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:54:35 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-2015c6d0-5947-4f78-a519-4822a203ab21 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2" status: 204 len: 0 microversion: 2.1 time: 0.119486 Apr 18 17:54:35 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 44/123] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:54:35 2023] DELETE /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] [instance: c576557f-02b5-4618-af9e-5cd2865db8b2] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c3485d9c96e4c24af53b5e0087b2197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d34c960d697434cbe8e088fe7a22ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:35 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-13695687-1f5b-4b88-8a98-5bdbe0272bee tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2" status: 200 len: 1494 microversion: 2.1 time: 0.291341 Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:35 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 39/124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:35 2023] GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2 => generated 1494 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-1dee6694-15f4-4746-b229-1079cd710170 req-d555b413-a6c7-4114-b7a7-baadfba9783e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c576557f-02b5-4618-af9e-5cd2865db8b2", "name": "network-vif-unplugged", "status": "completed", "tag": "f22acb06-0c4f-4cd5-88c4-190f1437c7dc"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-1dee6694-15f4-4746-b229-1079cd710170 req-d555b413-a6c7-4114-b7a7-baadfba9783e service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-1dee6694-15f4-4746-b229-1079cd710170 req-d555b413-a6c7-4114-b7a7-baadfba9783e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-1dee6694-15f4-4746-b229-1079cd710170 req-d555b413-a6c7-4114-b7a7-baadfba9783e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-1dee6694-15f4-4746-b229-1079cd710170 req-d555b413-a6c7-4114-b7a7-baadfba9783e service nova] Creating event network-vif-unplugged:f22acb06-0c4f-4cd5-88c4-190f1437c7dc for instance c576557f-02b5-4618-af9e-5cd2865db8b2 on user Apr 18 17:54:35 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-1dee6694-15f4-4746-b229-1079cd710170 req-d555b413-a6c7-4114-b7a7-baadfba9783e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026463 Apr 18 17:54:35 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 45/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:35 user devstack@n-api.service[61069]: DEBUG nova.objects.instance [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lazy-loading 'flavor' on Instance uuid 096bd7aa-fce5-49a2-9514-d559ce6657fe {{(pid=61069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 17:54:35 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-4684b1c5-9c32-49e3-b07b-ed9c46a62d47 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "POST /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe/action" status: 200 len: 32 microversion: 2.1 time: 0.454374 Apr 18 17:54:35 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 42/126] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 17:54:35 2023] POST /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe/action => generated 32 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:36 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:36 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:36 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-2c8c952a-8c0a-4371-b6a6-0a6e02a8b725 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe" status: 200 len: 1509 microversion: 2.1 time: 0.409409 Apr 18 17:54:36 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 40/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:35 2023] GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:36 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:36 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468cf6197f4a4d49b3a58255e999bf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c8ef9ed106494081b51a6bccc144a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:36 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-342f8e54-bf4e-4a84-ba73-5e1ea3913827 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969" status: 200 len: 1544 microversion: 2.1 time: 0.311604 Apr 18 17:54:36 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 46/128] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:36 2023] GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969 => generated 1544 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:36 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-6b4e6c4c-2498-42ad-bfdc-0a13c116931c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.182882 Apr 18 17:54:36 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 43/129] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 17:54:36 2023] GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7/os-interface => generated 282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:37 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c576557f-02b5-4618-af9e-5cd2865db8b2", "name": "network-vif-plugged", "status": "completed", "tag": "f22acb06-0c4f-4cd5-88c4-190f1437c7dc"}, {"server_uuid": "c576557f-02b5-4618-af9e-5cd2865db8b2", "name": "network-vif-deleted", "tag": "f22acb06-0c4f-4cd5-88c4-190f1437c7dc"}, {"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-unplugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}, {"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-plugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:37 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:37 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:37 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:37 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Creating event network-vif-plugged:f22acb06-0c4f-4cd5-88c4-190f1437c7dc for instance c576557f-02b5-4618-af9e-5cd2865db8b2 on user Apr 18 17:54:37 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Creating event network-vif-deleted:f22acb06-0c4f-4cd5-88c4-190f1437c7dc for instance c576557f-02b5-4618-af9e-5cd2865db8b2 on user Apr 18 17:54:37 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Creating event network-vif-unplugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:54:37 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] Creating event network-vif-plugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:54:37 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-da3730c7-fb0d-4cdc-9fd7-337c8774feb3 req-4d89b140-737e-416c-8ec0-5df814756521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.037175 Apr 18 17:54:37 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 41/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:37 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:38 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-53773f26-9515-4365-bec5-cb2260b8f675 req-b302382f-579f-4034-b254-b0f6c49885f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02122464-697c-4f0b-907f-30f6be1138f7", "tag": "15734420-8d2f-4a4c-8ecd-360d03fc5825"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-53773f26-9515-4365-bec5-cb2260b8f675 req-b302382f-579f-4034-b254-b0f6c49885f7 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-53773f26-9515-4365-bec5-cb2260b8f675 req-b302382f-579f-4034-b254-b0f6c49885f7 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-53773f26-9515-4365-bec5-cb2260b8f675 req-b302382f-579f-4034-b254-b0f6c49885f7 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:38 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-53773f26-9515-4365-bec5-cb2260b8f675 req-b302382f-579f-4034-b254-b0f6c49885f7 service nova] Creating event network-changed:15734420-8d2f-4a4c-8ecd-360d03fc5825 for instance 02122464-697c-4f0b-907f-30f6be1138f7 on user Apr 18 17:54:38 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-53773f26-9515-4365-bec5-cb2260b8f675 req-b302382f-579f-4034-b254-b0f6c49885f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030748 Apr 18 17:54:38 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 47/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2088914764"}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:38 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-01bb0dcc-46eb-4d5c-bcc1-fdcb39232fb9 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "POST /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7/action" status: 202 len: 0 microversion: 2.1 time: 0.831618 Apr 18 17:54:38 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 44/132] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 17:54:38 2023] POST /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 17:54:38 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-141c138c-abc1-463c-9faa-49c459e38add tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '.version_select at 0x7fb35b39a560>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:38 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-141c138c-abc1-463c-9faa-49c459e38add tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9" status: 200 len: 1609 microversion: 2.1 time: 0.049366 Apr 18 17:54:39 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 48/133] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 17:54:38 2023] GET /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9 => generated 1609 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:39 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-0c192f7d-72ae-4c82-b64a-390a56d8bc77 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.488927 Apr 18 17:54:39 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 42/134] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 17:54:38 2023] GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078/os-interface => generated 282 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:39 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-f91a3fb3-9788-45e6-886c-6bd7f5882f32 req-477757c5-2ce9-407c-a807-3b20208d25d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-plugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}, {"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-plugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-f91a3fb3-9788-45e6-886c-6bd7f5882f32 req-477757c5-2ce9-407c-a807-3b20208d25d9 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-f91a3fb3-9788-45e6-886c-6bd7f5882f32 req-477757c5-2ce9-407c-a807-3b20208d25d9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:39 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-f91a3fb3-9788-45e6-886c-6bd7f5882f32 req-477757c5-2ce9-407c-a807-3b20208d25d9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:39 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-f91a3fb3-9788-45e6-886c-6bd7f5882f32 req-477757c5-2ce9-407c-a807-3b20208d25d9 service nova] Creating event network-vif-plugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:54:39 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-f91a3fb3-9788-45e6-886c-6bd7f5882f32 req-477757c5-2ce9-407c-a807-3b20208d25d9 service nova] Creating event network-vif-plugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:54:39 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-f91a3fb3-9788-45e6-886c-6bd7f5882f32 req-477757c5-2ce9-407c-a807-3b20208d25d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033089 Apr 18 17:54:39 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:40 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-4405df2d-08ec-40d3-9fd2-add4be24e84a req-756649c6-50ee-4c9b-a60c-b042e3263c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a78732a0-37b0-4c31-8101-a68e40c82078", "tag": "9805f1ed-c55d-4486-b45b-c014901e103b"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:40 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4405df2d-08ec-40d3-9fd2-add4be24e84a req-756649c6-50ee-4c9b-a60c-b042e3263c4d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:40 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4405df2d-08ec-40d3-9fd2-add4be24e84a req-756649c6-50ee-4c9b-a60c-b042e3263c4d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:40 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4405df2d-08ec-40d3-9fd2-add4be24e84a req-756649c6-50ee-4c9b-a60c-b042e3263c4d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:40 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-4405df2d-08ec-40d3-9fd2-add4be24e84a req-756649c6-50ee-4c9b-a60c-b042e3263c4d service nova] Creating event network-changed:9805f1ed-c55d-4486-b45b-c014901e103b for instance a78732a0-37b0-4c31-8101-a68e40c82078 on user Apr 18 17:54:40 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-4405df2d-08ec-40d3-9fd2-add4be24e84a req-756649c6-50ee-4c9b-a60c-b042e3263c4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036291 Apr 18 17:54:40 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 49/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:42 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Going to try to terminate instance {{(pid=61070) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:54:42 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-41fa455a-199a-4b1f-83bb-b86c15a5766f tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078" status: 204 len: 0 microversion: 2.1 time: 0.390729 Apr 18 17:54:42 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 43/137] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:54:42 2023] DELETE /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-52f6ccf2-b58a-4f85-89c8-914ad64dd7dd req-08044b2c-7d7a-44de-a9b8-8467b2d70b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78732a0-37b0-4c31-8101-a68e40c82078", "name": "network-vif-unplugged", "status": "completed", "tag": "9805f1ed-c55d-4486-b45b-c014901e103b"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-52f6ccf2-b58a-4f85-89c8-914ad64dd7dd req-08044b2c-7d7a-44de-a9b8-8467b2d70b5c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-52f6ccf2-b58a-4f85-89c8-914ad64dd7dd req-08044b2c-7d7a-44de-a9b8-8467b2d70b5c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-52f6ccf2-b58a-4f85-89c8-914ad64dd7dd req-08044b2c-7d7a-44de-a9b8-8467b2d70b5c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-52f6ccf2-b58a-4f85-89c8-914ad64dd7dd req-08044b2c-7d7a-44de-a9b8-8467b2d70b5c service nova] Creating event network-vif-unplugged:9805f1ed-c55d-4486-b45b-c014901e103b for instance a78732a0-37b0-4c31-8101-a68e40c82078 on user Apr 18 17:54:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-52f6ccf2-b58a-4f85-89c8-914ad64dd7dd req-08044b2c-7d7a-44de-a9b8-8467b2d70b5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033534 Apr 18 17:54:42 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 50/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:42 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4904c9727144ebdaa5ddfd6059f5374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3253cf1033424d3dbbfc38e50ede4d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:42 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-61e0853b-9a3d-4225-80ee-29b080f731b1 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078" status: 200 len: 1672 microversion: 2.1 time: 0.492000 Apr 18 17:54:42 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:42 2023] GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 => generated 1672 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:44 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-f343ca88-c5f7-4649-878d-e7905d9f345d req-c5097e5e-d06c-427d-8846-3333b325ec58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78732a0-37b0-4c31-8101-a68e40c82078", "name": "network-vif-deleted", "tag": "9805f1ed-c55d-4486-b45b-c014901e103b"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:44 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-f343ca88-c5f7-4649-878d-e7905d9f345d req-c5097e5e-d06c-427d-8846-3333b325ec58 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:44 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-f343ca88-c5f7-4649-878d-e7905d9f345d req-c5097e5e-d06c-427d-8846-3333b325ec58 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:44 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-f343ca88-c5f7-4649-878d-e7905d9f345d req-c5097e5e-d06c-427d-8846-3333b325ec58 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:44 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-f343ca88-c5f7-4649-878d-e7905d9f345d req-c5097e5e-d06c-427d-8846-3333b325ec58 service nova] Creating event network-vif-deleted:9805f1ed-c55d-4486-b45b-c014901e103b for instance a78732a0-37b0-4c31-8101-a68e40c82078 on user Apr 18 17:54:44 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-f343ca88-c5f7-4649-878d-e7905d9f345d req-c5097e5e-d06c-427d-8846-3333b325ec58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031728 Apr 18 17:54:44 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 44/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:44 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-6ba24cc1-7825-4f11-8eea-8395563cb563 req-87323e27-21c9-4972-9026-14e08ee6ce16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a78732a0-37b0-4c31-8101-a68e40c82078", "name": "network-vif-plugged", "status": "completed", "tag": "9805f1ed-c55d-4486-b45b-c014901e103b"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-6ba24cc1-7825-4f11-8eea-8395563cb563 req-87323e27-21c9-4972-9026-14e08ee6ce16 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-6ba24cc1-7825-4f11-8eea-8395563cb563 req-87323e27-21c9-4972-9026-14e08ee6ce16 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-6ba24cc1-7825-4f11-8eea-8395563cb563 req-87323e27-21c9-4972-9026-14e08ee6ce16 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-6ba24cc1-7825-4f11-8eea-8395563cb563 req-87323e27-21c9-4972-9026-14e08ee6ce16 service nova] Creating event network-vif-plugged:9805f1ed-c55d-4486-b45b-c014901e103b for instance a78732a0-37b0-4c31-8101-a68e40c82078 on user Apr 18 17:54:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-6ba24cc1-7825-4f11-8eea-8395563cb563 req-87323e27-21c9-4972-9026-14e08ee6ce16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029978 Apr 18 17:54:44 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 51/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:45 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-1673633b-6a7a-4090-b113-10dbb2888636 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.485566 Apr 18 17:54:45 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 17:54:45 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2/os-interface => generated 283 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:46 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-02cf7036-1536-4184-9a8d-51140074e4f2 req-9756882d-e01b-4611-acc8-98c33b857c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ff41f2-dacf-49c7-8c2e-7621fbca6af2", "tag": "b76c25db-01e7-4cf3-9457-3c7e8ec1db2a"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:54:46 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-02cf7036-1536-4184-9a8d-51140074e4f2 req-9756882d-e01b-4611-acc8-98c33b857c65 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:46 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-02cf7036-1536-4184-9a8d-51140074e4f2 req-9756882d-e01b-4611-acc8-98c33b857c65 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:46 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-02cf7036-1536-4184-9a8d-51140074e4f2 req-9756882d-e01b-4611-acc8-98c33b857c65 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:46 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-02cf7036-1536-4184-9a8d-51140074e4f2 req-9756882d-e01b-4611-acc8-98c33b857c65 service nova] Creating event network-changed:b76c25db-01e7-4cf3-9457-3c7e8ec1db2a for instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 on user Apr 18 17:54:46 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-02cf7036-1536-4184-9a8d-51140074e4f2 req-9756882d-e01b-4611-acc8-98c33b857c65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Apr 18 17:54:46 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 45/143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:54:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:47 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:47 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-352fa3cf-492e-43c2-9f68-4c9eaa9e2d8f tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1539 microversion: 2.1 time: 0.323360 Apr 18 17:54:47 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 52/144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:46 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1539 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:54:47 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:54:47 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-f21c4c87-b91f-4c0f-8055-d4690c532342 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1539 microversion: 2.1 time: 0.138713 Apr 18 17:54:47 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:54:47 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1539 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:04 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c23c9d2ea01463fb831fb9dfb5971d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32403a8e23024e52bb44376bec5bc645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:04 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-8ef5a789-759d-4bce-a01d-2bade9e52ee3 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c" status: 200 len: 1566 microversion: 2.1 time: 0.219221 Apr 18 17:55:04 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 46/146] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:04 2023] GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:05 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:55:06 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-b9f43802-5874-4964-adee-37cfdbb48dec tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c" status: 204 len: 0 microversion: 2.1 time: 0.121201 Apr 18 17:55:06 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 53/147] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:55:05 2023] DELETE /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=18 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:06 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-3fae5543-03a1-475d-b3c1-22cd37f7e0bf req-c7038c98-e5c5-4801-a323-7c4f5e8b7d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c48dd69-57ab-4201-b122-dcbb4965419c", "name": "network-vif-unplugged", "status": "completed", "tag": "b7c677f3-0787-4806-87f4-87bc6f393feb"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:06 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-3fae5543-03a1-475d-b3c1-22cd37f7e0bf req-c7038c98-e5c5-4801-a323-7c4f5e8b7d93 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:06 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-3fae5543-03a1-475d-b3c1-22cd37f7e0bf req-c7038c98-e5c5-4801-a323-7c4f5e8b7d93 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:06 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-3fae5543-03a1-475d-b3c1-22cd37f7e0bf req-c7038c98-e5c5-4801-a323-7c4f5e8b7d93 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:06 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-3fae5543-03a1-475d-b3c1-22cd37f7e0bf req-c7038c98-e5c5-4801-a323-7c4f5e8b7d93 service nova] Creating event network-vif-unplugged:b7c677f3-0787-4806-87f4-87bc6f393feb for instance 9c48dd69-57ab-4201-b122-dcbb4965419c on user Apr 18 17:55:06 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-3fae5543-03a1-475d-b3c1-22cd37f7e0bf req-c7038c98-e5c5-4801-a323-7c4f5e8b7d93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031814 Apr 18 17:55:06 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 47/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:06 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c23c9d2ea01463fb831fb9dfb5971d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32403a8e23024e52bb44376bec5bc645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:06 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-ee4e819e-ea7b-4290-a0fa-f0217653bfe6 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c" status: 200 len: 1572 microversion: 2.1 time: 0.409522 Apr 18 17:55:06 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 49/149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:06 2023] GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c => generated 1572 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:07 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-97f592f9-a3cb-4d35-a957-24c74a9c7a17 req-f932b396-7602-4782-ae48-08ef04c915c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c48dd69-57ab-4201-b122-dcbb4965419c", "name": "network-vif-deleted", "tag": "b7c677f3-0787-4806-87f4-87bc6f393feb"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:07 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-97f592f9-a3cb-4d35-a957-24c74a9c7a17 req-f932b396-7602-4782-ae48-08ef04c915c6 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:07 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-97f592f9-a3cb-4d35-a957-24c74a9c7a17 req-f932b396-7602-4782-ae48-08ef04c915c6 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:07 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-97f592f9-a3cb-4d35-a957-24c74a9c7a17 req-f932b396-7602-4782-ae48-08ef04c915c6 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:07 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-97f592f9-a3cb-4d35-a957-24c74a9c7a17 req-f932b396-7602-4782-ae48-08ef04c915c6 service nova] Creating event network-vif-deleted:b7c677f3-0787-4806-87f4-87bc6f393feb for instance 9c48dd69-57ab-4201-b122-dcbb4965419c on user Apr 18 17:55:07 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-97f592f9-a3cb-4d35-a957-24c74a9c7a17 req-f932b396-7602-4782-ae48-08ef04c915c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028470 Apr 18 17:55:07 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 54/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:08 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-94593f67-d2af-4be3-9f55-868816616186 req-938fb936-1046-4736-a705-4f9c75470e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c48dd69-57ab-4201-b122-dcbb4965419c", "name": "network-vif-plugged", "status": "completed", "tag": "b7c677f3-0787-4806-87f4-87bc6f393feb"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:08 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-94593f67-d2af-4be3-9f55-868816616186 req-938fb936-1046-4736-a705-4f9c75470e65 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:08 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-94593f67-d2af-4be3-9f55-868816616186 req-938fb936-1046-4736-a705-4f9c75470e65 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:08 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-94593f67-d2af-4be3-9f55-868816616186 req-938fb936-1046-4736-a705-4f9c75470e65 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:08 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-94593f67-d2af-4be3-9f55-868816616186 req-938fb936-1046-4736-a705-4f9c75470e65 service nova] Creating event network-vif-plugged:b7c677f3-0787-4806-87f4-87bc6f393feb for instance 9c48dd69-57ab-4201-b122-dcbb4965419c on user Apr 18 17:55:08 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-94593f67-d2af-4be3-9f55-868816616186 req-938fb936-1046-4736-a705-4f9c75470e65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032050 Apr 18 17:55:08 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 48/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] [instance: c576557f-02b5-4618-af9e-5cd2865db8b2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:25 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] HTTP exception thrown: Instance c576557f-02b5-4618-af9e-5cd2865db8b2 could not be found. Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Request method failure captured: Apr 18 17:55:25 user devstack@n-api.service[61069]: request: GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2 HTTP/1.1 Apr 18 17:55:25 user devstack@n-api.service[61069]: Accept: application/json Apr 18 17:55:25 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 17:55:25 user devstack@n-api.service[61069]: Connection: close Apr 18 17:55:25 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 17:55:25 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 17:55:25 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 17:55:25 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 17:55:25 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtjnEPJXgnzMC03H8N76yy-NXKHZaVIBXye7KsEu4C7Mb0_w3Rb-5e0K9tDzJy58b7UMUFaBeo59D9QEe2REkFaPVyF0vZTUcy_i3D6ehqizZn_gzf5ncaRIaqApZf9-brhmmIIwvVyHAzZ6cb7WoZ7iDL9DxRvTOprSDDNGPwBzKeg Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Project-Id: 2d34c960d697434cbe8e088fe7a22ee2 Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Project-Name: tempest-DeleteServersTestJSON-231045211 Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d34c960d697434cbe8e088fe7a22ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d34c960d697434cbe8e088fe7a22ee2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d34c960d697434cbe8e088fe7a22ee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Tenant: tempest-DeleteServersTestJSON-231045211 Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Tenant-Id: 2d34c960d697434cbe8e088fe7a22ee2 Apr 18 17:55:25 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-DeleteServersTestJSON-231045211 Apr 18 17:55:25 user devstack@n-api.service[61069]: X-User: tempest-DeleteServersTestJSON-231045211-project-member Apr 18 17:55:25 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 17:55:25 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 17:55:25 user devstack@n-api.service[61069]: X-User-Id: 1c3485d9c96e4c24af53b5e0087b2197 Apr 18 17:55:25 user devstack@n-api.service[61069]: X-User-Name: tempest-DeleteServersTestJSON-231045211-project-member Apr 18 17:55:25 user devstack@n-api.service[61069]: method: > Apr 18 17:55:25 user devstack@n-api.service[61069]: exception: Instance c576557f-02b5-4618-af9e-5cd2865db8b2 could not be found. Apr 18 17:55:25 user devstack@n-api.service[61069]: action_args: {'id': 'c576557f-02b5-4618-af9e-5cd2865db8b2'} Apr 18 17:55:25 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c576557f-02b5-4618-af9e-5cd2865db8b2 could not be found. Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c576557f-02b5-4618-af9e-5cd2865db8b2 could not be found. Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c576557f-02b5-4618-af9e-5cd2865db8b2 could not be found. Apr 18 17:55:25 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:55:25 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] Returning 404 to user: Instance c576557f-02b5-4618-af9e-5cd2865db8b2 could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:55:25 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-c070fbae-50a8-4104-b979-8704f078b209 tempest-DeleteServersTestJSON-231045211 tempest-DeleteServersTestJSON-231045211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2" status: 404 len: 111 microversion: 2.1 time: 0.035477 Apr 18 17:55:25 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 50/152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:25 2023] GET /compute/v2.1/servers/c576557f-02b5-4618-af9e-5cd2865db8b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:26 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:26 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-48bd37cc-1d58-4c54-ba23-ad21ddfbea87 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe" status: 200 len: 1489 microversion: 2.1 time: 0.355241 Apr 18 17:55:26 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 55/153] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:26 2023] GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe => generated 1489 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:29 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:29 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=10 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:29 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-ec13ad06-ddf7-42f5-8a58-4bc4f67d1bd6 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '.version_select at 0x7fb35b456950>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:29 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-ec13ad06-ddf7-42f5-8a58-4bc4f67d1bd6 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9" status: 200 len: 1723 microversion: 2.1 time: 0.060234 Apr 18 17:55:29 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 49/154] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 17:55:29 2023] GET /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9 => generated 1723 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:29 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-d453188a-a08d-4016-954a-6bc0b1911917 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '.version_select at 0x7fb35b100ee0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:29 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-d453188a-a08d-4016-954a-6bc0b1911917 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9" status: 200 len: 1723 microversion: 2.1 time: 0.056072 Apr 18 17:55:29 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 51/155] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 17:55:29 2023] GET /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9 => generated 1723 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:29 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d327cd807144e3488b8a7dc33c0b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23950807b16a4c73b86650e4529a0156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:29 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-cb28ca97-2e91-45c1-a576-2f72a70237ff tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7" status: 200 len: 1667 microversion: 2.1 time: 0.292195 Apr 18 17:55:29 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 56/156] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:29 2023] GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 => generated 1667 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:30 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:30 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-e918e520-efdd-4e49-b82b-f3bed0483c17 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f" status: 200 len: 1536 microversion: 2.1 time: 0.214369 Apr 18 17:55:30 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 50/157] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:30 2023] GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f => generated 1536 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Searching by: {'deleted': False, 'project_id': 'af34eaf8745141928f32aab84e7264b6'} {{(pid=61069) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:30 user devstack@n-api.service[61069]: DEBUG nova.compute.multi_cell_list [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61069) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 17:55:30 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-b06a3d8e-318f-498d-a9f3-330f347ef2f3 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.203005 Apr 18 17:55:30 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 17:55:30 2023] GET /compute/v2.1/servers => generated 341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:30 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:30 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-5f914e4a-f71e-4b9d-bc1b-0f6695f51761 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f" status: 200 len: 1536 microversion: 2.1 time: 0.154567 Apr 18 17:55:30 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 57/159] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:30 2023] GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f => generated 1536 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-388049459", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "92a3fc19-c274-44eb-bd9d-958fdef4a359"}]}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] validate_networks() for [('92a3fc19-c274-44eb-bd9d-958fdef4a359', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for user 171127a60a304629949304db406a8f5b and project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:55:31 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:55:31 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-27846ecf-9cbf-43c5-9f19-a34ae1c85cd3 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.526727 Apr 18 17:55:31 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 51/160] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 17:55:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 17:55:31 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-8ed91535-aa71-4a31-a96d-8ebb2c02a187 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:31 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-8ed91535-aa71-4a31-a96d-8ebb2c02a187 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:31 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-8ed91535-aa71-4a31-a96d-8ebb2c02a187 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:31 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-8ed91535-aa71-4a31-a96d-8ebb2c02a187 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:31 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-8ed91535-aa71-4a31-a96d-8ebb2c02a187 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:31 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-8ed91535-aa71-4a31-a96d-8ebb2c02a187 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d" status: 200 len: 1394 microversion: 2.87 time: 0.076187 Apr 18 17:55:31 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 53/161] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:55:31 2023] GET /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d => generated 1394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:32 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:55:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-03efd98e-2234-42c3-842f-9386fb8fbb97 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f" status: 204 len: 0 microversion: 2.1 time: 0.128935 Apr 18 17:55:32 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 58/162] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:55:32 2023] DELETE /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:32 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:32 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-4c4a0baf-b519-4f5b-9432-f7b509ce5e27 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f" status: 200 len: 1542 microversion: 2.1 time: 0.292266 Apr 18 17:55:32 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 52/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:32 2023] GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f => generated 1542 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:32 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-0a1ba167-4374-4c71-80aa-ca6f3d8f9716 req-0a614626-55b6-4fa5-a9cc-6f413edfbb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d51dc75-e26a-4a97-bec1-6a3eba84685f", "name": "network-vif-unplugged", "status": "completed", "tag": "92f00d1e-213d-4aca-b5c4-5ebff96f994e"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0a1ba167-4374-4c71-80aa-ca6f3d8f9716 req-0a614626-55b6-4fa5-a9cc-6f413edfbb7e service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0a1ba167-4374-4c71-80aa-ca6f3d8f9716 req-0a614626-55b6-4fa5-a9cc-6f413edfbb7e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0a1ba167-4374-4c71-80aa-ca6f3d8f9716 req-0a614626-55b6-4fa5-a9cc-6f413edfbb7e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:32 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-0a1ba167-4374-4c71-80aa-ca6f3d8f9716 req-0a614626-55b6-4fa5-a9cc-6f413edfbb7e service nova] Creating event network-vif-unplugged:92f00d1e-213d-4aca-b5c4-5ebff96f994e for instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f on user Apr 18 17:55:32 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-0a1ba167-4374-4c71-80aa-ca6f3d8f9716 req-0a614626-55b6-4fa5-a9cc-6f413edfbb7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039136 Apr 18 17:55:32 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] HTTP exception thrown: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Request method failure captured: Apr 18 17:55:33 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 HTTP/1.1 Apr 18 17:55:33 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:55:33 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:55:33 user devstack@n-api.service[61068]: Connection: close Apr 18 17:55:33 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 17:55:33 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:55:33 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:55:33 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:55:33 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjV-C1uSdPGhS9UKhP1lEVi-AKmHdVNC8esG4WBeHlFGsekQTbHMtYaCaKK3Z7qCwNTp34O1EXuyRdg0uxTSbUV4lMCDpOhr-lK4AyPc1JVyJPrIRLcUamyQSOAs-0UaOkY68rNdB0I7HhEWAJtcYbgEWyVTZ088xduR-g-IkPlMd4 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Project-Id: 3253cf1033424d3dbbfc38e50ede4d42 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Tenant-Id: 3253cf1033424d3dbbfc38e50ede4d42 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-User: tempest-AttachSCSIVolumeTestJSON-1591623582-project-member Apr 18 17:55:33 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:55:33 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:55:33 user devstack@n-api.service[61068]: X-User-Id: b4904c9727144ebdaa5ddfd6059f5374 Apr 18 17:55:33 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1591623582-project-member Apr 18 17:55:33 user devstack@n-api.service[61068]: method: > Apr 18 17:55:33 user devstack@n-api.service[61068]: exception: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:33 user devstack@n-api.service[61068]: action_args: {'id': 'a78732a0-37b0-4c31-8101-a68e40c82078'} Apr 18 17:55:33 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:33 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:33 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Returning 404 to user: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:55:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-63d08fb3-c847-4947-954a-a07ccc45ca69 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078" status: 404 len: 111 microversion: 2.1 time: 0.035854 Apr 18 17:55:33 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 59/165] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:33 2023] GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:55:33 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-00299847-26f4-4892-933e-a6189e0bf1b8 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '.version_select at 0x7fb35c80ce50>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-00299847-26f4-4892-933e-a6189e0bf1b8 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346673688" status: 202 len: 0 microversion: 2.1 time: 0.024024 Apr 18 17:55:33 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 53/166] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 17:55:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346673688 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-4a3be928-c115-4f34-8d93-d8b77c817e79 req-f4b2367e-905b-4eec-a081-710a77f26838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d51dc75-e26a-4a97-bec1-6a3eba84685f", "name": "network-vif-deleted", "tag": "92f00d1e-213d-4aca-b5c4-5ebff96f994e"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-4a3be928-c115-4f34-8d93-d8b77c817e79 req-f4b2367e-905b-4eec-a081-710a77f26838 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-4a3be928-c115-4f34-8d93-d8b77c817e79 req-f4b2367e-905b-4eec-a081-710a77f26838 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-4a3be928-c115-4f34-8d93-d8b77c817e79 req-f4b2367e-905b-4eec-a081-710a77f26838 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:34 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-4a3be928-c115-4f34-8d93-d8b77c817e79 req-f4b2367e-905b-4eec-a081-710a77f26838 service nova] Creating event network-vif-deleted:92f00d1e-213d-4aca-b5c4-5ebff96f994e for instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f on user Apr 18 17:55:34 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-4a3be928-c115-4f34-8d93-d8b77c817e79 req-f4b2367e-905b-4eec-a081-710a77f26838 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038239 Apr 18 17:55:34 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 55/167] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:34 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] HTTP exception thrown: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Request method failure captured: Apr 18 17:55:34 user devstack@n-api.service[61068]: request: DELETE /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 HTTP/1.1 Apr 18 17:55:34 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:55:34 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:55:34 user devstack@n-api.service[61068]: Connection: close Apr 18 17:55:34 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 17:55:34 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:55:34 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:55:34 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:55:34 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjV-C1uSdPGhS9UKhP1lEVi-AKmHdVNC8esG4WBeHlFGsekQTbHMtYaCaKK3Z7qCwNTp34O1EXuyRdg0uxTSbUV4lMCDpOhr-lK4AyPc1JVyJPrIRLcUamyQSOAs-0UaOkY68rNdB0I7HhEWAJtcYbgEWyVTZ088xduR-g-IkPlMd4 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Project-Id: 3253cf1033424d3dbbfc38e50ede4d42 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Tenant-Id: 3253cf1033424d3dbbfc38e50ede4d42 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-User: tempest-AttachSCSIVolumeTestJSON-1591623582-project-member Apr 18 17:55:34 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:55:34 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:55:34 user devstack@n-api.service[61068]: X-User-Id: b4904c9727144ebdaa5ddfd6059f5374 Apr 18 17:55:34 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1591623582-project-member Apr 18 17:55:34 user devstack@n-api.service[61068]: method: > Apr 18 17:55:34 user devstack@n-api.service[61068]: exception: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61068]: action_args: {'id': 'a78732a0-37b0-4c31-8101-a68e40c82078'} Apr 18 17:55:34 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Returning 404 to user: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:55:34 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-dd2181dd-5f6b-498e-875b-b5e6bcf59463 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078" status: 404 len: 111 microversion: 2.1 time: 0.031368 Apr 18 17:55:34 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 60/168] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:55:34 2023] DELETE /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] [instance: a78732a0-37b0-4c31-8101-a68e40c82078] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:34 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] HTTP exception thrown: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Request method failure captured: Apr 18 17:55:34 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 HTTP/1.1 Apr 18 17:55:34 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:55:34 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:55:34 user devstack@n-api.service[61070]: Connection: close Apr 18 17:55:34 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 17:55:34 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:55:34 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:55:34 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:55:34 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtjV-C1uSdPGhS9UKhP1lEVi-AKmHdVNC8esG4WBeHlFGsekQTbHMtYaCaKK3Z7qCwNTp34O1EXuyRdg0uxTSbUV4lMCDpOhr-lK4AyPc1JVyJPrIRLcUamyQSOAs-0UaOkY68rNdB0I7HhEWAJtcYbgEWyVTZ088xduR-g-IkPlMd4 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Project-Id: 3253cf1033424d3dbbfc38e50ede4d42 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3253cf1033424d3dbbfc38e50ede4d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Tenant-Id: 3253cf1033424d3dbbfc38e50ede4d42 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1591623582 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-User: tempest-AttachSCSIVolumeTestJSON-1591623582-project-member Apr 18 17:55:34 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:55:34 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:55:34 user devstack@n-api.service[61070]: X-User-Id: b4904c9727144ebdaa5ddfd6059f5374 Apr 18 17:55:34 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1591623582-project-member Apr 18 17:55:34 user devstack@n-api.service[61070]: method: > Apr 18 17:55:34 user devstack@n-api.service[61070]: exception: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61070]: action_args: {'id': 'a78732a0-37b0-4c31-8101-a68e40c82078'} Apr 18 17:55:34 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. Apr 18 17:55:34 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:34 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] Returning 404 to user: Instance a78732a0-37b0-4c31-8101-a68e40c82078 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:55:34 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-42edb7ad-82df-4484-ad9b-fa3b2bef5a61 tempest-AttachSCSIVolumeTestJSON-1591623582 tempest-AttachSCSIVolumeTestJSON-1591623582-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078" status: 404 len: 111 microversion: 2.1 time: 0.039654 Apr 18 17:55:34 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 54/169] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:34 2023] GET /compute/v2.1/servers/a78732a0-37b0-4c31-8101-a68e40c82078 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-5c960fd3-d7a6-456a-a352-0599117f6c43 req-d45de242-5d76-4f66-9c3a-30e6a02b0883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e853895-ea80-42f0-b823-8960a2282e8d", "tag": "65bd2987-52e9-4e76-8416-0527f91243e2"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5c960fd3-d7a6-456a-a352-0599117f6c43 req-d45de242-5d76-4f66-9c3a-30e6a02b0883 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5c960fd3-d7a6-456a-a352-0599117f6c43 req-d45de242-5d76-4f66-9c3a-30e6a02b0883 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:34 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-5c960fd3-d7a6-456a-a352-0599117f6c43 req-d45de242-5d76-4f66-9c3a-30e6a02b0883 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:34 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-5c960fd3-d7a6-456a-a352-0599117f6c43 req-d45de242-5d76-4f66-9c3a-30e6a02b0883 service nova] Creating event network-changed:65bd2987-52e9-4e76-8416-0527f91243e2 for instance 2e853895-ea80-42f0-b823-8960a2282e8d on user Apr 18 17:55:34 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-5c960fd3-d7a6-456a-a352-0599117f6c43 req-d45de242-5d76-4f66-9c3a-30e6a02b0883 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043065 Apr 18 17:55:34 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 56/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-5117c318-0c49-4fe3-8492-3ee35fc66d0c req-4186b198-d9e1-466d-8418-b69e8527a3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d51dc75-e26a-4a97-bec1-6a3eba84685f", "name": "network-vif-plugged", "status": "completed", "tag": "92f00d1e-213d-4aca-b5c4-5ebff96f994e"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5117c318-0c49-4fe3-8492-3ee35fc66d0c req-4186b198-d9e1-466d-8418-b69e8527a3c9 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5117c318-0c49-4fe3-8492-3ee35fc66d0c req-4186b198-d9e1-466d-8418-b69e8527a3c9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5117c318-0c49-4fe3-8492-3ee35fc66d0c req-4186b198-d9e1-466d-8418-b69e8527a3c9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:34 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5117c318-0c49-4fe3-8492-3ee35fc66d0c req-4186b198-d9e1-466d-8418-b69e8527a3c9 service nova] Creating event network-vif-plugged:92f00d1e-213d-4aca-b5c4-5ebff96f994e for instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f on user Apr 18 17:55:34 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-5117c318-0c49-4fe3-8492-3ee35fc66d0c req-4186b198-d9e1-466d-8418-b69e8527a3c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045508 Apr 18 17:55:34 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 61/171] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:36 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:37 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-d4f230ac-011e-4a1c-b1a3-7c6a8e75c44a tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.164463 Apr 18 17:55:37 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 55/172] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 17:55:36 2023] GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969/os-interface => generated 282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:38 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:38 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-071e6982-c84d-48d8-82aa-40dc116a8467 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.982191 Apr 18 17:55:38 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:37 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:38 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:38 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-445cc94c-9e26-41f0-a4c0-9b13d9ff5038 req-f02ede3b-c0b8-4a85-889b-c9ae0382a518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-445cc94c-9e26-41f0-a4c0-9b13d9ff5038 req-f02ede3b-c0b8-4a85-889b-c9ae0382a518 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-445cc94c-9e26-41f0-a4c0-9b13d9ff5038 req-f02ede3b-c0b8-4a85-889b-c9ae0382a518 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:38 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-445cc94c-9e26-41f0-a4c0-9b13d9ff5038 req-f02ede3b-c0b8-4a85-889b-c9ae0382a518 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:38 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-445cc94c-9e26-41f0-a4c0-9b13d9ff5038 req-f02ede3b-c0b8-4a85-889b-c9ae0382a518 service nova] Creating event network-changed:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:55:38 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-445cc94c-9e26-41f0-a4c0-9b13d9ff5038 req-f02ede3b-c0b8-4a85-889b-c9ae0382a518 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036352 Apr 18 17:55:38 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 56/174] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:39 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:39 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-db3f6050-32a9-43c0-8b00-3df6c8749b41 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.752622 Apr 18 17:55:39 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 62/175] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:38 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:40 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-a0e77702-08eb-4e0d-b198-970d244cbfa1 req-faab8e80-4305-4163-b04a-4be1d6e57cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e853895-ea80-42f0-b823-8960a2282e8d", "name": "network-vif-deleted", "tag": "65bd2987-52e9-4e76-8416-0527f91243e2"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a0e77702-08eb-4e0d-b198-970d244cbfa1 req-faab8e80-4305-4163-b04a-4be1d6e57cfe service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a0e77702-08eb-4e0d-b198-970d244cbfa1 req-faab8e80-4305-4163-b04a-4be1d6e57cfe service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a0e77702-08eb-4e0d-b198-970d244cbfa1 req-faab8e80-4305-4163-b04a-4be1d6e57cfe service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:40 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.compute.server_external_events [req-a0e77702-08eb-4e0d-b198-970d244cbfa1 req-faab8e80-4305-4163-b04a-4be1d6e57cfe service nova] Unable to find a host for instance 2e853895-ea80-42f0-b823-8960a2282e8d. Dropping event network-vif-deleted {{(pid=61069) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 17:55:40 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-a0e77702-08eb-4e0d-b198-970d244cbfa1 req-faab8e80-4305-4163-b04a-4be1d6e57cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.025282 Apr 18 17:55:40 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 58/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:40 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1748412423", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "22d94a93-462a-4392-a96a-21d97b0e7fd1"}]}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] validate_networks() for [('22d94a93-462a-4392-a96a-21d97b0e7fd1', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Getting quotas for project 84c8ef9ed106494081b51a6bccc144a6. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Getting quotas for user 468cf6197f4a4d49b3a58255e999bf9e and project 84c8ef9ed106494081b51a6bccc144a6. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:55:40 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: b85d00fa-2bb6-4a4e-b424-aacb039caffc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:55:41 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-85001b08-7d9a-42d2-a9ff-2415c6535390 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.538263 Apr 18 17:55:41 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 57/177] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:55:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:55:41 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-e2cff48a-ca30-430d-9619-cd5391bd26aa tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:41 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-e2cff48a-ca30-430d-9619-cd5391bd26aa tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: b85d00fa-2bb6-4a4e-b424-aacb039caffc] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:41 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-e2cff48a-ca30-430d-9619-cd5391bd26aa tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468cf6197f4a4d49b3a58255e999bf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c8ef9ed106494081b51a6bccc144a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:41 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-e2cff48a-ca30-430d-9619-cd5391bd26aa tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc" status: 200 len: 1212 microversion: 2.1 time: 0.078658 Apr 18 17:55:41 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 63/178] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:41 2023] GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc => generated 1212 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:43 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-e36d418c-2e61-4d01-bd31-31e9302275fe req-f168db3a-e3c3-4ed1-834f-0fbaf6135f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85d00fa-2bb6-4a4e-b424-aacb039caffc", "tag": "2962fc92-a349-4d39-a269-67f74313bf9f"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:43 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:43 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e36d418c-2e61-4d01-bd31-31e9302275fe req-f168db3a-e3c3-4ed1-834f-0fbaf6135f37 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e36d418c-2e61-4d01-bd31-31e9302275fe req-f168db3a-e3c3-4ed1-834f-0fbaf6135f37 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e36d418c-2e61-4d01-bd31-31e9302275fe req-f168db3a-e3c3-4ed1-834f-0fbaf6135f37 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:43 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-e36d418c-2e61-4d01-bd31-31e9302275fe req-f168db3a-e3c3-4ed1-834f-0fbaf6135f37 service nova] Creating event network-changed:2962fc92-a349-4d39-a269-67f74313bf9f for instance b85d00fa-2bb6-4a4e-b424-aacb039caffc on user Apr 18 17:55:43 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-e36d418c-2e61-4d01-bd31-31e9302275fe req-f168db3a-e3c3-4ed1-834f-0fbaf6135f37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042233 Apr 18 17:55:43 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 59/179] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:45 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-a5013cc1-496c-4c0d-830d-d8d03c29568f req-3a29895b-6911-4aaf-8793-155b9467570c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85d00fa-2bb6-4a4e-b424-aacb039caffc", "name": "network-vif-plugged", "status": "completed", "tag": "2962fc92-a349-4d39-a269-67f74313bf9f"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-a5013cc1-496c-4c0d-830d-d8d03c29568f req-3a29895b-6911-4aaf-8793-155b9467570c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-a5013cc1-496c-4c0d-830d-d8d03c29568f req-3a29895b-6911-4aaf-8793-155b9467570c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-a5013cc1-496c-4c0d-830d-d8d03c29568f req-3a29895b-6911-4aaf-8793-155b9467570c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:45 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-a5013cc1-496c-4c0d-830d-d8d03c29568f req-3a29895b-6911-4aaf-8793-155b9467570c service nova] Creating event network-vif-plugged:2962fc92-a349-4d39-a269-67f74313bf9f for instance b85d00fa-2bb6-4a4e-b424-aacb039caffc on user Apr 18 17:55:45 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-a5013cc1-496c-4c0d-830d-d8d03c29568f req-3a29895b-6911-4aaf-8793-155b9467570c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043679 Apr 18 17:55:45 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 58/180] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:47 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-4fe0e695-2197-4247-8616-31312767549f req-976dc111-7fb7-42ef-aa65-17a3655f3cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85d00fa-2bb6-4a4e-b424-aacb039caffc", "name": "network-vif-plugged", "status": "completed", "tag": "2962fc92-a349-4d39-a269-67f74313bf9f"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:47 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4fe0e695-2197-4247-8616-31312767549f req-976dc111-7fb7-42ef-aa65-17a3655f3cf8 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:47 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4fe0e695-2197-4247-8616-31312767549f req-976dc111-7fb7-42ef-aa65-17a3655f3cf8 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:47 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4fe0e695-2197-4247-8616-31312767549f req-976dc111-7fb7-42ef-aa65-17a3655f3cf8 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:47 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-4fe0e695-2197-4247-8616-31312767549f req-976dc111-7fb7-42ef-aa65-17a3655f3cf8 service nova] Creating event network-vif-plugged:2962fc92-a349-4d39-a269-67f74313bf9f for instance b85d00fa-2bb6-4a4e-b424-aacb039caffc on user Apr 18 17:55:47 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-4fe0e695-2197-4247-8616-31312767549f req-976dc111-7fb7-42ef-aa65-17a3655f3cf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Apr 18 17:55:47 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 64/181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1020806056", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "ed8499ec-3077-410f-82b0-dda9c802c975"}]}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] validate_networks() for [('ed8499ec-3077-410f-82b0-dda9c802c975', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Getting quotas for project 68fd3d6d08674a8a830c500c6094b348. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:55:49 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Getting quotas for user ed8490deab814653a759dbaf493f582a and project 68fd3d6d08674a8a830c500c6094b348. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:55:50 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:55:50 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] [instance: 06c6ec9c-bb35-4059-a18c-56fc998eb4e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:55:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-215feb6f-1de3-4655-a6f7-68a64944a26b tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.014779 Apr 18 17:55:50 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 60/182] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:55:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 18 17:55:50 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-8d32f776-9b14-4ed0-8020-2af00a796b24 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:50 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-8d32f776-9b14-4ed0-8020-2af00a796b24 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] [instance: 06c6ec9c-bb35-4059-a18c-56fc998eb4e0] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:50 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-8d32f776-9b14-4ed0-8020-2af00a796b24 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8490deab814653a759dbaf493f582a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fd3d6d08674a8a830c500c6094b348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:55:50 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-8d32f776-9b14-4ed0-8020-2af00a796b24 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0" status: 200 len: 1208 microversion: 2.1 time: 0.076533 Apr 18 17:55:50 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 59/183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:50 2023] GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0 => generated 1208 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:55:52 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:52 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-cf8615d4-d33f-4489-97b8-b2fb50573cea req-03620049-f27a-487c-b1aa-3f534462afdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c6ec9c-bb35-4059-a18c-56fc998eb4e0", "tag": "d7b0185b-dac8-4338-bef0-480925e8fbb7"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:53 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-cf8615d4-d33f-4489-97b8-b2fb50573cea req-03620049-f27a-487c-b1aa-3f534462afdc service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:53 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-cf8615d4-d33f-4489-97b8-b2fb50573cea req-03620049-f27a-487c-b1aa-3f534462afdc service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:53 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-cf8615d4-d33f-4489-97b8-b2fb50573cea req-03620049-f27a-487c-b1aa-3f534462afdc service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:53 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-cf8615d4-d33f-4489-97b8-b2fb50573cea req-03620049-f27a-487c-b1aa-3f534462afdc service nova] Creating event network-changed:d7b0185b-dac8-4338-bef0-480925e8fbb7 for instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 on user Apr 18 17:55:53 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-cf8615d4-d33f-4489-97b8-b2fb50573cea req-03620049-f27a-487c-b1aa-3f534462afdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042914 Apr 18 17:55:53 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 65/184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:55 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-96331093-0f5d-46e8-8881-75d4d0ff5912 req-7f177a18-32d6-4dff-a388-7bac9555dd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c6ec9c-bb35-4059-a18c-56fc998eb4e0", "name": "network-vif-plugged", "status": "completed", "tag": "d7b0185b-dac8-4338-bef0-480925e8fbb7"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:55 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-96331093-0f5d-46e8-8881-75d4d0ff5912 req-7f177a18-32d6-4dff-a388-7bac9555dd2a service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:55 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-96331093-0f5d-46e8-8881-75d4d0ff5912 req-7f177a18-32d6-4dff-a388-7bac9555dd2a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:55 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-96331093-0f5d-46e8-8881-75d4d0ff5912 req-7f177a18-32d6-4dff-a388-7bac9555dd2a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:55 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-96331093-0f5d-46e8-8881-75d4d0ff5912 req-7f177a18-32d6-4dff-a388-7bac9555dd2a service nova] Creating event network-vif-plugged:d7b0185b-dac8-4338-bef0-480925e8fbb7 for instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 on user Apr 18 17:55:55 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-96331093-0f5d-46e8-8881-75d4d0ff5912 req-7f177a18-32d6-4dff-a388-7bac9555dd2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Apr 18 17:55:55 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] [instance: 9c48dd69-57ab-4201-b122-dcbb4965419c] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=26 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:56 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] HTTP exception thrown: Instance 9c48dd69-57ab-4201-b122-dcbb4965419c could not be found. Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Request method failure captured: Apr 18 17:55:56 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c HTTP/1.1 Apr 18 17:55:56 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:55:56 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:55:56 user devstack@n-api.service[61070]: Connection: close Apr 18 17:55:56 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 17:55:56 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:55:56 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:55:56 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:55:56 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtjwHB7PzXlGDoG4r3tg8BpAt8XKDhpeJBGFnXfzulLCj36f0yI5WcaNVzbcvkuxZEEi5R7hwXy7aIpGCvXCNBd3myoyDufGU4rctjpgG544qLl9rZ5U3DjN6nkCzxw8ihgYZ72nUvO6kIoHQSme_mpDfY1MHxLDPbT5IrfKp3VK4kI Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Project-Id: 32403a8e23024e52bb44376bec5bc645 Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Project-Name: tempest-SnapshotDataIntegrityTests-812790989 Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32403a8e23024e52bb44376bec5bc645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/32403a8e23024e52bb44376bec5bc645"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/32403a8e23024e52bb44376bec5bc645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Tenant: tempest-SnapshotDataIntegrityTests-812790989 Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Tenant-Id: 32403a8e23024e52bb44376bec5bc645 Apr 18 17:55:56 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-812790989 Apr 18 17:55:56 user devstack@n-api.service[61070]: X-User: tempest-SnapshotDataIntegrityTests-812790989-project-member Apr 18 17:55:56 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:55:56 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:55:56 user devstack@n-api.service[61070]: X-User-Id: 4c23c9d2ea01463fb831fb9dfb5971d0 Apr 18 17:55:56 user devstack@n-api.service[61070]: X-User-Name: tempest-SnapshotDataIntegrityTests-812790989-project-member Apr 18 17:55:56 user devstack@n-api.service[61070]: method: > Apr 18 17:55:56 user devstack@n-api.service[61070]: exception: Instance 9c48dd69-57ab-4201-b122-dcbb4965419c could not be found. Apr 18 17:55:56 user devstack@n-api.service[61070]: action_args: {'id': '9c48dd69-57ab-4201-b122-dcbb4965419c'} Apr 18 17:55:56 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c48dd69-57ab-4201-b122-dcbb4965419c could not be found. Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c48dd69-57ab-4201-b122-dcbb4965419c could not be found. Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c48dd69-57ab-4201-b122-dcbb4965419c could not be found. Apr 18 17:55:56 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:55:56 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Returning 404 to user: Instance 9c48dd69-57ab-4201-b122-dcbb4965419c could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:55:56 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-82a9116d-c140-4259-bfca-e9d8e7893b30 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c" status: 404 len: 111 microversion: 2.1 time: 0.038806 Apr 18 17:55:56 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 60/186] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:55:56 2023] GET /compute/v2.1/servers/9c48dd69-57ab-4201-b122-dcbb4965419c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:55:57 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-23084c32-a245-4160-9277-b1049dab00a5 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] Calling method '.version_select at 0x7fb35b16d000>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:55:57 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:57 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-23084c32-a245-4160-9277-b1049dab00a5 tempest-SnapshotDataIntegrityTests-812790989 tempest-SnapshotDataIntegrityTests-812790989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-31044549" status: 202 len: 0 microversion: 2.1 time: 0.058697 Apr 18 17:55:57 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 66/187] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 17:55:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-31044549 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:55:57 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-7ab59caa-ce43-4249-be18-7e82540482a0 req-8a038912-64c5-4475-915a-22020b0c23ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c6ec9c-bb35-4059-a18c-56fc998eb4e0", "name": "network-vif-plugged", "status": "completed", "tag": "d7b0185b-dac8-4338-bef0-480925e8fbb7"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:55:57 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:57 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-7ab59caa-ce43-4249-be18-7e82540482a0 req-8a038912-64c5-4475-915a-22020b0c23ed service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:55:57 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-7ab59caa-ce43-4249-be18-7e82540482a0 req-8a038912-64c5-4475-915a-22020b0c23ed service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:55:57 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-7ab59caa-ce43-4249-be18-7e82540482a0 req-8a038912-64c5-4475-915a-22020b0c23ed service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:55:57 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=31 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:55:57 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-7ab59caa-ce43-4249-be18-7e82540482a0 req-8a038912-64c5-4475-915a-22020b0c23ed service nova] Creating event network-vif-plugged:d7b0185b-dac8-4338-bef0-480925e8fbb7 for instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 on user Apr 18 17:55:57 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-7ab59caa-ce43-4249-be18-7e82540482a0 req-8a038912-64c5-4475-915a-22020b0c23ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056555 Apr 18 17:55:57 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 62/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:55:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:15 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=14 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:15 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:15 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:15 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-119635d9-e389-420b-8cf7-443761bedbca tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Action: 'create', calling method: .version_select at 0x7fb35b3eb400>, body: {"keypair": {"name": "tempest-keypair-890549411", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJovf5XzCaI/zufXFbgp61rOjLTXHHZNrxXKLaTcLd1ZykVPTbEpsV0ktIds93F54/YlE0oiN8a/OfnybwHMGdHkzHMNY8UzcFt5i+7DmQdFblJF3SJkKU2SHYPaEeYiA=="}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:15 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-119635d9-e389-420b-8cf7-443761bedbca tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for project fbfd165764d6457ba971b760fc1f6718. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:56:15 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-119635d9-e389-420b-8cf7-443761bedbca tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for user c167bb97deb24907a1fb757b13e0a840 and project fbfd165764d6457ba971b760fc1f6718. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:56:15 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-119635d9-e389-420b-8cf7-443761bedbca tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170885 Apr 18 17:56:15 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 61/189] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:56:15 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-516493013", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "349cb244-24d7-4014-8bdf-ec2dbc00aed5"}], "security_groups": [{"name": "tempest-securitygroup--125002171"}], "key_name": "tempest-keypair-890549411", "user_data": "}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] validate_networks() for [('349cb244-24d7-4014-8bdf-ec2dbc00aed5', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for project fbfd165764d6457ba971b760fc1f6718. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for user c167bb97deb24907a1fb757b13e0a840 and project fbfd165764d6457ba971b760fc1f6718. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:56:17 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:56:17 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-59e12c41-e4d5-46c6-8cd5-be39073a8b4a tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.630398 Apr 18 17:56:17 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 67/190] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:56:17 2023] POST /compute/v2.1/servers => generated 399 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:56:17 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:17 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:17 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:17 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:17 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-4d03a70f-3b04-4977-bd20-a42b3104d6e9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:17 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-4d03a70f-3b04-4977-bd20-a42b3104d6e9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:18 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-4d03a70f-3b04-4977-bd20-a42b3104d6e9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c167bb97deb24907a1fb757b13e0a840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfd165764d6457ba971b760fc1f6718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:18 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-4d03a70f-3b04-4977-bd20-a42b3104d6e9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62" status: 200 len: 1230 microversion: 2.1 time: 0.071643 Apr 18 17:56:18 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:17 2023] GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 => generated 1230 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:56:20 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-0343e45a-9008-4df4-9775-9602a106f212 req-2257cbf1-a8cb-4c12-a95d-281ee49f420d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de60266-38a3-4baf-9b87-aaf7199edb62", "tag": "ec7942d2-08f9-428f-b5a4-8f4e831bb29c"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:20 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0343e45a-9008-4df4-9775-9602a106f212 req-2257cbf1-a8cb-4c12-a95d-281ee49f420d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:20 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0343e45a-9008-4df4-9775-9602a106f212 req-2257cbf1-a8cb-4c12-a95d-281ee49f420d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:20 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0343e45a-9008-4df4-9775-9602a106f212 req-2257cbf1-a8cb-4c12-a95d-281ee49f420d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:20 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-0343e45a-9008-4df4-9775-9602a106f212 req-2257cbf1-a8cb-4c12-a95d-281ee49f420d service nova] Creating event network-changed:ec7942d2-08f9-428f-b5a4-8f4e831bb29c for instance 8de60266-38a3-4baf-9b87-aaf7199edb62 on user Apr 18 17:56:20 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-0343e45a-9008-4df4-9775-9602a106f212 req-2257cbf1-a8cb-4c12-a95d-281ee49f420d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032053 Apr 18 17:56:20 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 62/192] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG nova.objects.instance [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lazy-loading 'fault' on Instance uuid 2e853895-ea80-42f0-b823-8960a2282e8d {{(pid=61068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:21 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:21 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-00e56f72-7a25-4a82-9683-89efb9aa9776 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d" status: 200 len: 1649 microversion: 2.87 time: 0.111959 Apr 18 17:56:21 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 68/193] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:56:21 2023] GET /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d => generated 1649 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Doing local delete in cell 9d27f925-8bed-44bf-a25d-45ceb80a7926(cell1) {{(pid=61069) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:22 user devstack@n-api.service[61069]: WARNING nova.compute.api [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] instance's host None is down, deleting from database Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] deallocate_for_instance() {{(pid=61069) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Instance cache missing network info. {{(pid=61069) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Updating instance_info_cache with network_info: [] {{(pid=61069) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61069) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 17:56:22 user devstack@n-api.service[61069]: WARNING nova.compute.api [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 17:56:22 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-bdc3f691-bb97-4e2a-8c66-d9f7214a5ad7 req-baa6ecf3-3499-43a4-b1a6-f5e76aad0705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de60266-38a3-4baf-9b87-aaf7199edb62", "name": "network-vif-plugged", "status": "completed", "tag": "ec7942d2-08f9-428f-b5a4-8f4e831bb29c"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:22 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-bdc3f691-bb97-4e2a-8c66-d9f7214a5ad7 req-baa6ecf3-3499-43a4-b1a6-f5e76aad0705 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:22 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-bdc3f691-bb97-4e2a-8c66-d9f7214a5ad7 req-baa6ecf3-3499-43a4-b1a6-f5e76aad0705 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:22 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-bdc3f691-bb97-4e2a-8c66-d9f7214a5ad7 req-baa6ecf3-3499-43a4-b1a6-f5e76aad0705 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:22 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-bdc3f691-bb97-4e2a-8c66-d9f7214a5ad7 req-baa6ecf3-3499-43a4-b1a6-f5e76aad0705 service nova] Creating event network-vif-plugged:ec7942d2-08f9-428f-b5a4-8f4e831bb29c for instance 8de60266-38a3-4baf-9b87-aaf7199edb62 on user Apr 18 17:56:22 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-bdc3f691-bb97-4e2a-8c66-d9f7214a5ad7 req-baa6ecf3-3499-43a4-b1a6-f5e76aad0705 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045554 Apr 18 17:56:22 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 63/194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:22 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-47ec030c-0bcb-4dfb-b29b-2e7e3ee772fe tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d" status: 204 len: 0 microversion: 2.87 time: 0.588727 Apr 18 17:56:22 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 64/195] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 17:56:21 2023] DELETE /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 2e853895-ea80-42f0-b823-8960a2282e8d] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:22 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] HTTP exception thrown: Instance 2e853895-ea80-42f0-b823-8960a2282e8d could not be found. Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Request method failure captured: Apr 18 17:56:22 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d HTTP/1.1 Apr 18 17:56:22 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:56:22 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:56:22 user devstack@n-api.service[61068]: Connection: close Apr 18 17:56:22 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 17:56:22 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:56:22 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:56:22 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:56:22 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjeVJnpaNHYnMzFonBBnErtLbF5emN6SBqB2IfGIp5OgYGulgAS0-uonuBGrn5LKzCt9BayLxQyVRmqxZA2VtQEftu8EtTP1iOdybAn7wIylN6N9iC3Iu6iQ7H4-2YYYaS9JgZ0lk4cwATmnxiyBLMj4xR1ZiboL_FFnl9jlAs_NNc Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Project-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03373e65e776406e823e7cc2b277d205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Tenant-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 17:56:22 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 17:56:22 user devstack@n-api.service[61068]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 17:56:22 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:56:22 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:56:22 user devstack@n-api.service[61068]: X-User-Id: 171127a60a304629949304db406a8f5b Apr 18 17:56:22 user devstack@n-api.service[61068]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 17:56:22 user devstack@n-api.service[61068]: method: > Apr 18 17:56:22 user devstack@n-api.service[61068]: exception: Instance 2e853895-ea80-42f0-b823-8960a2282e8d could not be found. Apr 18 17:56:22 user devstack@n-api.service[61068]: action_args: {'id': '2e853895-ea80-42f0-b823-8960a2282e8d'} Apr 18 17:56:22 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e853895-ea80-42f0-b823-8960a2282e8d could not be found. Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e853895-ea80-42f0-b823-8960a2282e8d could not be found. Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e853895-ea80-42f0-b823-8960a2282e8d could not be found. Apr 18 17:56:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Returning 404 to user: Instance 2e853895-ea80-42f0-b823-8960a2282e8d could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:56:22 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-068b9b1e-3162-4be1-92c5-af8dcbf50387 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d" status: 404 len: 111 microversion: 2.87 time: 0.037691 Apr 18 17:56:22 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 69/196] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:56:22 2023] GET /compute/v2.1/servers/2e853895-ea80-42f0-b823-8960a2282e8d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 17:56:22 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-298580635", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "92a3fc19-c274-44eb-bd9d-958fdef4a359"}]}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 7d51dc75-e26a-4a97-bec1-6a3eba84685f] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:22 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] validate_networks() for [('92a3fc19-c274-44eb-bd9d-958fdef4a359', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:22 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] HTTP exception thrown: Instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f could not be found. Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Request method failure captured: Apr 18 17:56:22 user devstack@n-api.service[61069]: request: GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f HTTP/1.1 Apr 18 17:56:22 user devstack@n-api.service[61069]: Accept: application/json Apr 18 17:56:22 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 17:56:22 user devstack@n-api.service[61069]: Connection: close Apr 18 17:56:22 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 17:56:22 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 17:56:22 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 17:56:22 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 17:56:22 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtkSDN3Y_YlPZdMPnFGYm9jU8qb-OfvGbElesvmC56fG-5Yhj0xwgWnqozk5LM91u5OTKzFqEFD1ufccgEnkSpnEFXcSl5eGyy0eNX9yL-f7zW-8mc5JJojW4WvFtQaJuRKnq6--XHbZvEinPsdxJSRvHLKgDhQzluD7-1D2tmHyXZ4 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Project-Id: af34eaf8745141928f32aab84e7264b6 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Project-Name: tempest-TestMinimumBasicScenario-796860875 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34eaf8745141928f32aab84e7264b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34eaf8745141928f32aab84e7264b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af34eaf8745141928f32aab84e7264b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Tenant: tempest-TestMinimumBasicScenario-796860875 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Tenant-Id: af34eaf8745141928f32aab84e7264b6 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-TestMinimumBasicScenario-796860875 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-User: tempest-TestMinimumBasicScenario-796860875-project-member Apr 18 17:56:22 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 17:56:22 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 17:56:22 user devstack@n-api.service[61069]: X-User-Id: f250508b0762464ebf52fc73f1f49ac8 Apr 18 17:56:22 user devstack@n-api.service[61069]: X-User-Name: tempest-TestMinimumBasicScenario-796860875-project-member Apr 18 17:56:22 user devstack@n-api.service[61069]: method: > Apr 18 17:56:22 user devstack@n-api.service[61069]: exception: Instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f could not be found. Apr 18 17:56:22 user devstack@n-api.service[61069]: action_args: {'id': '7d51dc75-e26a-4a97-bec1-6a3eba84685f'} Apr 18 17:56:22 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f could not be found. Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f could not be found. Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f could not be found. Apr 18 17:56:22 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:56:22 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Returning 404 to user: Instance 7d51dc75-e26a-4a97-bec1-6a3eba84685f could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:56:22 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-9938a16d-bc35-44e9-88da-9b31d8918d86 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f" status: 404 len: 111 microversion: 2.1 time: 0.040550 Apr 18 17:56:22 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:22 2023] GET /compute/v2.1/servers/7d51dc75-e26a-4a97-bec1-6a3eba84685f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:56:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-56240e29-4037-4f9a-8834-522bd46889a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '.version_select at 0x7fb35bef4790>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:22 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-56240e29-4037-4f9a-8834-522bd46889a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-951182281" status: 202 len: 0 microversion: 2.1 time: 0.035619 Apr 18 17:56:22 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 70/198] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 18 17:56:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-951182281 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for user 171127a60a304629949304db406a8f5b and project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:56:23 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:56:23 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-643fc6ce-1baf-46a1-a9ba-f7ba29c07232 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.609611 Apr 18 17:56:23 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 64/199] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 17:56:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 17:56:23 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-4464f0fb-99be-494c-bbe2-166c2cbec52e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:23 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-4464f0fb-99be-494c-bbe2-166c2cbec52e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:23 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-4464f0fb-99be-494c-bbe2-166c2cbec52e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:23 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-4464f0fb-99be-494c-bbe2-166c2cbec52e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:23 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-4464f0fb-99be-494c-bbe2-166c2cbec52e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:23 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-4464f0fb-99be-494c-bbe2-166c2cbec52e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5" status: 200 len: 1394 microversion: 2.87 time: 0.075020 Apr 18 17:56:23 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 66/200] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:56:23 2023] GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 => generated 1394 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:56:24 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-96903ecf-b0e8-4564-b7c2-ca5526792d2b req-b7ab3136-ef54-4da6-8401-0bffef472c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de60266-38a3-4baf-9b87-aaf7199edb62", "name": "network-vif-plugged", "status": "completed", "tag": "ec7942d2-08f9-428f-b5a4-8f4e831bb29c"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-96903ecf-b0e8-4564-b7c2-ca5526792d2b req-b7ab3136-ef54-4da6-8401-0bffef472c74 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-96903ecf-b0e8-4564-b7c2-ca5526792d2b req-b7ab3136-ef54-4da6-8401-0bffef472c74 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:24 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-96903ecf-b0e8-4564-b7c2-ca5526792d2b req-b7ab3136-ef54-4da6-8401-0bffef472c74 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:24 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-96903ecf-b0e8-4564-b7c2-ca5526792d2b req-b7ab3136-ef54-4da6-8401-0bffef472c74 service nova] Creating event network-vif-plugged:ec7942d2-08f9-428f-b5a4-8f4e831bb29c for instance 8de60266-38a3-4baf-9b87-aaf7199edb62 on user Apr 18 17:56:24 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-96903ecf-b0e8-4564-b7c2-ca5526792d2b req-b7ab3136-ef54-4da6-8401-0bffef472c74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039135 Apr 18 17:56:24 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 71/201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:25 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-58b4c30a-6e72-4ce2-ab16-31d7d3633302 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Action: 'create', calling method: .version_select at 0x7fb35b4b7eb0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1708263975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxmcFUWfOuuwnvgQil6j+QWxq1euxebVmvcs3E3It/rPQ4cHzcR7GxUJG4GoB5S4mtB2mq/LEpyjZCsYzZO8AhlZgeh1I3kp89g/XpvoOmm7zNHl62sGlSfL/UWPB1IxQ=="}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:25 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-58b4c30a-6e72-4ce2-ab16-31d7d3633302 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for project af34eaf8745141928f32aab84e7264b6. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:56:25 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-58b4c30a-6e72-4ce2-ab16-31d7d3633302 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for user f250508b0762464ebf52fc73f1f49ac8 and project af34eaf8745141928f32aab84e7264b6. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:56:25 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-58b4c30a-6e72-4ce2-ab16-31d7d3633302 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052364 Apr 18 17:56:25 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 65/202] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:56:25 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2086888586", "imageRef": "6e009548-df4d-4ff1-b63c-44db8269edda", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1708263975", "networks": [{"uuid": "2bd27561-80e1-4278-89f3-4ca5c3a7aa81"}]}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] validate_networks() for [('2bd27561-80e1-4278-89f3-4ca5c3a7aa81', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:25 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for project af34eaf8745141928f32aab84e7264b6. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Getting quotas for user f250508b0762464ebf52fc73f1f49ac8 and project af34eaf8745141928f32aab84e7264b6. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6e009548-df4d-4ff1-b63c-44db8269edda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:56:26 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-3e4fcb75-caf8-46e3-b29f-6cd8f6a3f86b tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.623145 Apr 18 17:56:26 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 67/203] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:56:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:56:26 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-2819c33b-6693-4a30-8934-783f651b7534 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:26 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-2819c33b-6693-4a30-8934-783f651b7534 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:26 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-8511ea6b-7f40-4e6b-8fa7-8f4684f92e87 req-02eda2c4-8ba5-44f1-aee1-c9e23560c927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5", "tag": "f408febd-2774-4fec-877e-15e5b6e01e20"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:26 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-2819c33b-6693-4a30-8934-783f651b7534 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-8511ea6b-7f40-4e6b-8fa7-8f4684f92e87 req-02eda2c4-8ba5-44f1-aee1-c9e23560c927 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-8511ea6b-7f40-4e6b-8fa7-8f4684f92e87 req-02eda2c4-8ba5-44f1-aee1-c9e23560c927 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-8511ea6b-7f40-4e6b-8fa7-8f4684f92e87 req-02eda2c4-8ba5-44f1-aee1-c9e23560c927 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:26 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-2819c33b-6693-4a30-8934-783f651b7534 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0" status: 200 len: 1253 microversion: 2.1 time: 0.084831 Apr 18 17:56:26 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 72/204] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:26 2023] GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:56:26 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-8511ea6b-7f40-4e6b-8fa7-8f4684f92e87 req-02eda2c4-8ba5-44f1-aee1-c9e23560c927 service nova] Creating event network-changed:f408febd-2774-4fec-877e-15e5b6e01e20 for instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 on user Apr 18 17:56:26 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-8511ea6b-7f40-4e6b-8fa7-8f4684f92e87 req-02eda2c4-8ba5-44f1-aee1-c9e23560c927 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036217 Apr 18 17:56:26 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 66/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: d60955fa-c17f-4588-8348-2b8f5991564d] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:27 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-a5fecb82-64db-4ed0-b4e5-9680da81c655 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d" status: 200 len: 1505 microversion: 2.1 time: 0.268717 Apr 18 17:56:27 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:26 2023] GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:56:28 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-c4e860f1-51e7-4589-ade2-359a210efcb0 req-5cb7d612-df95-4d32-9e9b-a7546ccaf4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5", "name": "network-vif-plugged", "status": "completed", "tag": "f408febd-2774-4fec-877e-15e5b6e01e20"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:28 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:28 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c4e860f1-51e7-4589-ade2-359a210efcb0 req-5cb7d612-df95-4d32-9e9b-a7546ccaf4cf service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:28 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c4e860f1-51e7-4589-ade2-359a210efcb0 req-5cb7d612-df95-4d32-9e9b-a7546ccaf4cf service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:28 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c4e860f1-51e7-4589-ade2-359a210efcb0 req-5cb7d612-df95-4d32-9e9b-a7546ccaf4cf service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:28 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-c4e860f1-51e7-4589-ade2-359a210efcb0 req-5cb7d612-df95-4d32-9e9b-a7546ccaf4cf service nova] Creating event network-vif-plugged:f408febd-2774-4fec-877e-15e5b6e01e20 for instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 on user Apr 18 17:56:28 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-c4e860f1-51e7-4589-ade2-359a210efcb0 req-5cb7d612-df95-4d32-9e9b-a7546ccaf4cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051060 Apr 18 17:56:28 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 73/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:29 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-737a7d81-062c-4463-99fc-d7a1e6aad630 req-e6abcf16-f51f-42b2-b794-5abce6dd41b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127fc340-ffc6-48d3-a32d-312bf1b162b0", "tag": "7449de31-9caf-40bd-b53d-1aae3df449a9"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-737a7d81-062c-4463-99fc-d7a1e6aad630 req-e6abcf16-f51f-42b2-b794-5abce6dd41b4 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-737a7d81-062c-4463-99fc-d7a1e6aad630 req-e6abcf16-f51f-42b2-b794-5abce6dd41b4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:29 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-737a7d81-062c-4463-99fc-d7a1e6aad630 req-e6abcf16-f51f-42b2-b794-5abce6dd41b4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:29 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-737a7d81-062c-4463-99fc-d7a1e6aad630 req-e6abcf16-f51f-42b2-b794-5abce6dd41b4 service nova] Creating event network-changed:7449de31-9caf-40bd-b53d-1aae3df449a9 for instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 on user Apr 18 17:56:29 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-737a7d81-062c-4463-99fc-d7a1e6aad630 req-e6abcf16-f51f-42b2-b794-5abce6dd41b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043700 Apr 18 17:56:29 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 67/208] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:30 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d327cd807144e3488b8a7dc33c0b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23950807b16a4c73b86650e4529a0156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:30 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-84c13cf4-e2e7-4a92-9aa0-11b8a18d14a5 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7" status: 200 len: 1667 microversion: 2.1 time: 0.230229 Apr 18 17:56:30 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 69/209] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:29 2023] GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 => generated 1667 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:56:30 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-4ffc8731-c12b-4033-b548-d6bb59849a1a req-4ea412fa-7c8a-48ac-b801-03644b78c62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5", "name": "network-vif-plugged", "status": "completed", "tag": "f408febd-2774-4fec-877e-15e5b6e01e20"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4ffc8731-c12b-4033-b548-d6bb59849a1a req-4ea412fa-7c8a-48ac-b801-03644b78c62c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4ffc8731-c12b-4033-b548-d6bb59849a1a req-4ea412fa-7c8a-48ac-b801-03644b78c62c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4ffc8731-c12b-4033-b548-d6bb59849a1a req-4ea412fa-7c8a-48ac-b801-03644b78c62c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:30 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-4ffc8731-c12b-4033-b548-d6bb59849a1a req-4ea412fa-7c8a-48ac-b801-03644b78c62c service nova] Creating event network-vif-plugged:f408febd-2774-4fec-877e-15e5b6e01e20 for instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 on user Apr 18 17:56:30 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-4ffc8731-c12b-4033-b548-d6bb59849a1a req-4ea412fa-7c8a-48ac-b801-03644b78c62c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033401 Apr 18 17:56:30 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 74/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: b85d00fa-2bb6-4a4e-b424-aacb039caffc] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:31 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468cf6197f4a4d49b3a58255e999bf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c8ef9ed106494081b51a6bccc144a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:31 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-d4139668-2df1-467c-af60-e4a459a157ba tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc" status: 200 len: 1496 microversion: 2.1 time: 0.274435 Apr 18 17:56:31 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 68/211] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:31 2023] GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc => generated 1496 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:56:31 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-9a4580cf-044d-4d36-a971-8b6b6175a983 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '.version_select at 0x7fb35b0ae9e0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:31 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-9a4580cf-044d-4d36-a971-8b6b6175a983 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9" status: 204 len: 0 microversion: 2.1 time: 0.281650 Apr 18 17:56:31 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 70/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:31 2023] DELETE /compute/v2.1/images/5504884a-542e-4aa8-9629-4e3d85d16ba9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:31 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:32 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:56:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-a307b573-8c59-4299-9f73-459e2bfcfa30 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7" status: 204 len: 0 microversion: 2.1 time: 0.138383 Apr 18 17:56:32 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 75/213] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:56:31 2023] DELETE /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:32 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-a88f9670-637c-4216-8ae6-3f3dff904480 req-730d1f95-3f11-4d56-9eb7-d17c04dad7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02122464-697c-4f0b-907f-30f6be1138f7", "name": "network-vif-unplugged", "status": "completed", "tag": "15734420-8d2f-4a4c-8ecd-360d03fc5825"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a88f9670-637c-4216-8ae6-3f3dff904480 req-730d1f95-3f11-4d56-9eb7-d17c04dad7e7 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a88f9670-637c-4216-8ae6-3f3dff904480 req-730d1f95-3f11-4d56-9eb7-d17c04dad7e7 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a88f9670-637c-4216-8ae6-3f3dff904480 req-730d1f95-3f11-4d56-9eb7-d17c04dad7e7 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:32 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-a88f9670-637c-4216-8ae6-3f3dff904480 req-730d1f95-3f11-4d56-9eb7-d17c04dad7e7 service nova] Creating event network-vif-unplugged:15734420-8d2f-4a4c-8ecd-360d03fc5825 for instance 02122464-697c-4f0b-907f-30f6be1138f7 on user Apr 18 17:56:32 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-a88f9670-637c-4216-8ae6-3f3dff904480 req-730d1f95-3f11-4d56-9eb7-d17c04dad7e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103329 Apr 18 17:56:32 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 71/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:32 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-214cd7fc-2a35-4dd8-b1dc-e1713014d458 req-a5163a58-befd-4462-9fe1-e1f2b6522853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fc340-ffc6-48d3-a32d-312bf1b162b0", "name": "network-vif-plugged", "status": "completed", "tag": "7449de31-9caf-40bd-b53d-1aae3df449a9"}, {"server_uuid": "127fc340-ffc6-48d3-a32d-312bf1b162b0", "name": "network-vif-plugged", "status": "completed", "tag": "7449de31-9caf-40bd-b53d-1aae3df449a9"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-214cd7fc-2a35-4dd8-b1dc-e1713014d458 req-a5163a58-befd-4462-9fe1-e1f2b6522853 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-214cd7fc-2a35-4dd8-b1dc-e1713014d458 req-a5163a58-befd-4462-9fe1-e1f2b6522853 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-214cd7fc-2a35-4dd8-b1dc-e1713014d458 req-a5163a58-befd-4462-9fe1-e1f2b6522853 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-214cd7fc-2a35-4dd8-b1dc-e1713014d458 req-a5163a58-befd-4462-9fe1-e1f2b6522853 service nova] Creating event network-vif-plugged:7449de31-9caf-40bd-b53d-1aae3df449a9 for instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 on user Apr 18 17:56:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-214cd7fc-2a35-4dd8-b1dc-e1713014d458 req-a5163a58-befd-4462-9fe1-e1f2b6522853 service nova] Creating event network-vif-plugged:7449de31-9caf-40bd-b53d-1aae3df449a9 for instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 on user Apr 18 17:56:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-214cd7fc-2a35-4dd8-b1dc-e1713014d458 req-a5163a58-befd-4462-9fe1-e1f2b6522853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033352 Apr 18 17:56:32 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 76/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:32 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d327cd807144e3488b8a7dc33c0b740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23950807b16a4c73b86650e4529a0156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:32 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-4ebd7cf8-8ce1-4a12-9cce-97cca754cd5f tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7" status: 200 len: 1673 microversion: 2.1 time: 0.565261 Apr 18 17:56:32 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 69/216] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:32 2023] GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 => generated 1673 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:56:33 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-0975ee67-de16-4ebd-96e4-9f9b7d42d039 req-6098c4ee-a437-4078-bf13-c17dd5ace181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02122464-697c-4f0b-907f-30f6be1138f7", "name": "network-vif-deleted", "tag": "15734420-8d2f-4a4c-8ecd-360d03fc5825"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0975ee67-de16-4ebd-96e4-9f9b7d42d039 req-6098c4ee-a437-4078-bf13-c17dd5ace181 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0975ee67-de16-4ebd-96e4-9f9b7d42d039 req-6098c4ee-a437-4078-bf13-c17dd5ace181 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0975ee67-de16-4ebd-96e4-9f9b7d42d039 req-6098c4ee-a437-4078-bf13-c17dd5ace181 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:34 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-0975ee67-de16-4ebd-96e4-9f9b7d42d039 req-6098c4ee-a437-4078-bf13-c17dd5ace181 service nova] Creating event network-vif-deleted:15734420-8d2f-4a4c-8ecd-360d03fc5825 for instance 02122464-697c-4f0b-907f-30f6be1138f7 on user Apr 18 17:56:34 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-0975ee67-de16-4ebd-96e4-9f9b7d42d039 req-6098c4ee-a437-4078-bf13-c17dd5ace181 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060362 Apr 18 17:56:34 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 72/217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:34 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-4111733d-0720-4283-b4f6-8d98b6df5df8 req-ad20dd1e-adbe-4230-9b63-c50d2dcb7dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02122464-697c-4f0b-907f-30f6be1138f7", "name": "network-vif-plugged", "status": "completed", "tag": "15734420-8d2f-4a4c-8ecd-360d03fc5825"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:56:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4111733d-0720-4283-b4f6-8d98b6df5df8 req-ad20dd1e-adbe-4230-9b63-c50d2dcb7dfa service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4111733d-0720-4283-b4f6-8d98b6df5df8 req-ad20dd1e-adbe-4230-9b63-c50d2dcb7dfa service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:34 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4111733d-0720-4283-b4f6-8d98b6df5df8 req-ad20dd1e-adbe-4230-9b63-c50d2dcb7dfa service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:34 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-4111733d-0720-4283-b4f6-8d98b6df5df8 req-ad20dd1e-adbe-4230-9b63-c50d2dcb7dfa service nova] Creating event network-vif-plugged:15734420-8d2f-4a4c-8ecd-360d03fc5825 for instance 02122464-697c-4f0b-907f-30f6be1138f7 on user Apr 18 17:56:34 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-4111733d-0720-4283-b4f6-8d98b6df5df8 req-ad20dd1e-adbe-4230-9b63-c50d2dcb7dfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033706 Apr 18 17:56:34 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 77/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:56:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=14 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] [instance: 06c6ec9c-bb35-4059-a18c-56fc998eb4e0] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:40 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8490deab814653a759dbaf493f582a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fd3d6d08674a8a830c500c6094b348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:40 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-18c3b617-5b62-4236-81b6-472f4ac1da03 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0" status: 200 len: 1485 microversion: 2.1 time: 0.298512 Apr 18 17:56:40 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 70/219] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:40 2023] GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0 => generated 1485 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=10 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:56:40 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:56:40 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-403729fe-b4de-4097-bd96-eba203708812 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.259014 Apr 18 17:56:40 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:56:40 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=8 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:08 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c167bb97deb24907a1fb757b13e0a840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfd165764d6457ba971b760fc1f6718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:08 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-ec7463e1-788b-4b88-82af-b95a5e5558b9 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62" status: 200 len: 1535 microversion: 2.1 time: 0.252278 Apr 18 17:57:08 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 78/221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:08 2023] GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 => generated 1535 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=5 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=28 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:13 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:13 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-699ccea6-0862-4b4e-b56f-6de875c94dc8 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5" status: 200 len: 1691 microversion: 2.87 time: 0.354656 Apr 18 17:57:13 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 71/222] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:57:13 2023] GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 => generated 1691 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:16 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:16 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-5f5309da-bee6-42cd-93ce-0341bf3277a9 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0" status: 200 len: 1537 microversion: 2.1 time: 0.329483 Apr 18 17:57:16 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 74/223] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:16 2023] GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 => generated 1537 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] [instance: 02122464-697c-4f0b-907f-30f6be1138f7] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:22 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] HTTP exception thrown: Instance 02122464-697c-4f0b-907f-30f6be1138f7 could not be found. Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Request method failure captured: Apr 18 17:57:22 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 HTTP/1.1 Apr 18 17:57:22 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:57:22 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:57:22 user devstack@n-api.service[61068]: Connection: close Apr 18 17:57:22 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 17:57:22 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:57:22 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:57:22 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:57:22 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjjfmpCFclutWjmn8cfAMB6ATsIgDyx8BExIZNWvPh-RH8AMTgBzgSYGIv9JZ66TNm94XFFIJTH8Lt3XTmB71HKYpXeGWW0GEc8ZjiGsIhwlLPOKqKvSuN-YttiVdJ8ACJPkISio-7EU7QeoKScjMMgjB45vBsZaW1voNt44s2kQ2k Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Project-Id: 23950807b16a4c73b86650e4529a0156 Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Project-Name: tempest-ServerStableDeviceRescueTest-708848625 Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23950807b16a4c73b86650e4529a0156"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23950807b16a4c73b86650e4529a0156"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23950807b16a4c73b86650e4529a0156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Tenant: tempest-ServerStableDeviceRescueTest-708848625 Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Tenant-Id: 23950807b16a4c73b86650e4529a0156 Apr 18 17:57:22 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-708848625 Apr 18 17:57:22 user devstack@n-api.service[61068]: X-User: tempest-ServerStableDeviceRescueTest-708848625-project-member Apr 18 17:57:22 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:57:22 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:57:22 user devstack@n-api.service[61068]: X-User-Id: 1d327cd807144e3488b8a7dc33c0b740 Apr 18 17:57:22 user devstack@n-api.service[61068]: X-User-Name: tempest-ServerStableDeviceRescueTest-708848625-project-member Apr 18 17:57:22 user devstack@n-api.service[61068]: method: > Apr 18 17:57:22 user devstack@n-api.service[61068]: exception: Instance 02122464-697c-4f0b-907f-30f6be1138f7 could not be found. Apr 18 17:57:22 user devstack@n-api.service[61068]: action_args: {'id': '02122464-697c-4f0b-907f-30f6be1138f7'} Apr 18 17:57:22 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02122464-697c-4f0b-907f-30f6be1138f7 could not be found. Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02122464-697c-4f0b-907f-30f6be1138f7 could not be found. Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02122464-697c-4f0b-907f-30f6be1138f7 could not be found. Apr 18 17:57:22 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:57:22 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Returning 404 to user: Instance 02122464-697c-4f0b-907f-30f6be1138f7 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:57:22 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-9382b769-fb0d-4cb0-bd95-20a64abf298c tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7" status: 404 len: 111 microversion: 2.1 time: 0.033480 Apr 18 17:57:22 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 79/224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:22 2023] GET /compute/v2.1/servers/02122464-697c-4f0b-907f-30f6be1138f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:57:22 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-7740ec5e-5aa8-4b5d-8e43-9e22174b8ac1 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] Calling method '.version_select at 0x7fb35b2640d0>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:22 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-7740ec5e-5aa8-4b5d-8e43-9e22174b8ac1 tempest-ServerStableDeviceRescueTest-708848625 tempest-ServerStableDeviceRescueTest-708848625-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117431546" status: 202 len: 0 microversion: 2.1 time: 0.038828 Apr 18 17:57:22 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 72/225] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 17:57:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1117431546 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:30 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:57:30 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-08aaee90-edd9-4eb2-8332-0fdfd828ea69 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe" status: 204 len: 0 microversion: 2.1 time: 0.119225 Apr 18 17:57:30 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:57:30 2023] DELETE /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:30 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:30 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-d84ff87b-7f79-408d-a69e-6c17c97ba984 req-c875bc76-234e-4175-99cd-c61daad7c9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-unplugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:30 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-d84ff87b-7f79-408d-a69e-6c17c97ba984 req-c875bc76-234e-4175-99cd-c61daad7c9f4 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-d84ff87b-7f79-408d-a69e-6c17c97ba984 req-c875bc76-234e-4175-99cd-c61daad7c9f4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:30 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-d84ff87b-7f79-408d-a69e-6c17c97ba984 req-c875bc76-234e-4175-99cd-c61daad7c9f4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:30 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-d84ff87b-7f79-408d-a69e-6c17c97ba984 req-c875bc76-234e-4175-99cd-c61daad7c9f4 service nova] Creating event network-vif-unplugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:57:30 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-d84ff87b-7f79-408d-a69e-6c17c97ba984 req-c875bc76-234e-4175-99cd-c61daad7c9f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041804 Apr 18 17:57:30 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 73/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:31 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:31 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-eaf8843e-5cb0-4a22-a46f-969a1b475f6a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe" status: 200 len: 1495 microversion: 2.1 time: 0.881634 Apr 18 17:57:31 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 80/228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:30 2023] GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe => generated 1495 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:31 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-4714b390-a365-4fd1-b137-7a8ac2c4de69 req-c2fe8b10-3ae0-43a1-910b-ff57760fdffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-deleted", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:31 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-4714b390-a365-4fd1-b137-7a8ac2c4de69 req-c2fe8b10-3ae0-43a1-910b-ff57760fdffa service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:31 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-4714b390-a365-4fd1-b137-7a8ac2c4de69 req-c2fe8b10-3ae0-43a1-910b-ff57760fdffa service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:31 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-4714b390-a365-4fd1-b137-7a8ac2c4de69 req-c2fe8b10-3ae0-43a1-910b-ff57760fdffa service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:31 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-4714b390-a365-4fd1-b137-7a8ac2c4de69 req-c2fe8b10-3ae0-43a1-910b-ff57760fdffa service nova] Creating event network-vif-deleted:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:57:31 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-4714b390-a365-4fd1-b137-7a8ac2c4de69 req-c2fe8b10-3ae0-43a1-910b-ff57760fdffa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038324 Apr 18 17:57:31 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 76/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:32 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-b6fee6aa-4f43-4433-865e-6d65e814b68d req-cd75f1f8-03e7-4ecf-b3a6-f101f41977a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096bd7aa-fce5-49a2-9514-d559ce6657fe", "name": "network-vif-plugged", "status": "completed", "tag": "e09478dd-28e6-434c-90f9-cb5670ad4a97"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-b6fee6aa-4f43-4433-865e-6d65e814b68d req-cd75f1f8-03e7-4ecf-b3a6-f101f41977a5 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-b6fee6aa-4f43-4433-865e-6d65e814b68d req-cd75f1f8-03e7-4ecf-b3a6-f101f41977a5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:32 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-b6fee6aa-4f43-4433-865e-6d65e814b68d req-cd75f1f8-03e7-4ecf-b3a6-f101f41977a5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-b6fee6aa-4f43-4433-865e-6d65e814b68d req-cd75f1f8-03e7-4ecf-b3a6-f101f41977a5 service nova] Creating event network-vif-plugged:e09478dd-28e6-434c-90f9-cb5670ad4a97 for instance 096bd7aa-fce5-49a2-9514-d559ce6657fe on user Apr 18 17:57:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-b6fee6aa-4f43-4433-865e-6d65e814b68d req-cd75f1f8-03e7-4ecf-b3a6-f101f41977a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034410 Apr 18 17:57:33 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 74/230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: b85d00fa-2bb6-4a4e-b424-aacb039caffc] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:33 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: b85d00fa-2bb6-4a4e-b424-aacb039caffc] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:57:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-86714dc3-bde7-40c3-a987-9b27db7326f0 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc" status: 204 len: 0 microversion: 2.1 time: 0.187663 Apr 18 17:57:33 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 81/231] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:57:33 2023] DELETE /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: b85d00fa-2bb6-4a4e-b424-aacb039caffc] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:33 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468cf6197f4a4d49b3a58255e999bf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c8ef9ed106494081b51a6bccc144a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:33 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-0e9705d4-15ac-47e2-ad1e-854cec3667a4 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc" status: 200 len: 1502 microversion: 2.1 time: 0.464448 Apr 18 17:57:33 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:33 2023] GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc => generated 1502 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:33 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-ae7765e1-10a8-4a4e-b3d3-eb3090029bfa req-286d83d9-9e3b-4f78-a78b-dcee4cbb77fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85d00fa-2bb6-4a4e-b424-aacb039caffc", "name": "network-vif-unplugged", "status": "completed", "tag": "2962fc92-a349-4d39-a269-67f74313bf9f"}, {"server_uuid": "b85d00fa-2bb6-4a4e-b424-aacb039caffc", "name": "network-vif-plugged", "status": "completed", "tag": "2962fc92-a349-4d39-a269-67f74313bf9f"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:33 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ae7765e1-10a8-4a4e-b3d3-eb3090029bfa req-286d83d9-9e3b-4f78-a78b-dcee4cbb77fd service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:33 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ae7765e1-10a8-4a4e-b3d3-eb3090029bfa req-286d83d9-9e3b-4f78-a78b-dcee4cbb77fd service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:33 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ae7765e1-10a8-4a4e-b3d3-eb3090029bfa req-286d83d9-9e3b-4f78-a78b-dcee4cbb77fd service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-ae7765e1-10a8-4a4e-b3d3-eb3090029bfa req-286d83d9-9e3b-4f78-a78b-dcee4cbb77fd service nova] Creating event network-vif-unplugged:2962fc92-a349-4d39-a269-67f74313bf9f for instance b85d00fa-2bb6-4a4e-b424-aacb039caffc on user Apr 18 17:57:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-ae7765e1-10a8-4a4e-b3d3-eb3090029bfa req-286d83d9-9e3b-4f78-a78b-dcee4cbb77fd service nova] Creating event network-vif-plugged:2962fc92-a349-4d39-a269-67f74313bf9f for instance b85d00fa-2bb6-4a4e-b424-aacb039caffc on user Apr 18 17:57:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-ae7765e1-10a8-4a4e-b3d3-eb3090029bfa req-286d83d9-9e3b-4f78-a78b-dcee4cbb77fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039492 Apr 18 17:57:33 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 75/233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:33 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:35 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-bfa680eb-7dec-430e-afd2-18e63fc9484a req-69199a60-d773-49ae-809a-a8f20cec17db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85d00fa-2bb6-4a4e-b424-aacb039caffc", "name": "network-vif-deleted", "tag": "2962fc92-a349-4d39-a269-67f74313bf9f"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bfa680eb-7dec-430e-afd2-18e63fc9484a req-69199a60-d773-49ae-809a-a8f20cec17db service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bfa680eb-7dec-430e-afd2-18e63fc9484a req-69199a60-d773-49ae-809a-a8f20cec17db service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bfa680eb-7dec-430e-afd2-18e63fc9484a req-69199a60-d773-49ae-809a-a8f20cec17db service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:35 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-bfa680eb-7dec-430e-afd2-18e63fc9484a req-69199a60-d773-49ae-809a-a8f20cec17db service nova] Creating event network-vif-deleted:2962fc92-a349-4d39-a269-67f74313bf9f for instance b85d00fa-2bb6-4a4e-b424-aacb039caffc on user Apr 18 17:57:35 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-bfa680eb-7dec-430e-afd2-18e63fc9484a req-69199a60-d773-49ae-809a-a8f20cec17db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033221 Apr 18 17:57:35 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 82/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:36 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-29384777", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "b5626892-4f68-45ee-b684-0283fd7bf7d5"}]}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:36 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] validate_networks() for [('b5626892-4f68-45ee-b684-0283fd7bf7d5', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Getting quotas for project df19b002da6742dbb8ed4009530e5f20. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Getting quotas for user 08887d6401f540fa9cf01c378af3c398 and project df19b002da6742dbb8ed4009530e5f20. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:57:37 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:57:37 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-4f099ee4-0e3e-4f2c-abe6-abee934ac6f8 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.688848 Apr 18 17:57:37 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 78/235] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:57:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:57:37 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-cb441e51-13a6-4910-8333-326e5a092e8e tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:37 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-cb441e51-13a6-4910-8333-326e5a092e8e tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:37 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-cb441e51-13a6-4910-8333-326e5a092e8e tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:37 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-cb441e51-13a6-4910-8333-326e5a092e8e tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 200 len: 1209 microversion: 2.1 time: 0.068103 Apr 18 17:57:37 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 76/236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:37 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 1209 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:40 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-f35dcbec-743e-465d-8ef8-452459ada39e req-83880029-c514-4e9d-9d14-696c29c63c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4fd3db-b881-441a-90b7-b927392288fb", "tag": "535fdace-a2a4-4073-acaa-20534cfb3050"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:40 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-f35dcbec-743e-465d-8ef8-452459ada39e req-83880029-c514-4e9d-9d14-696c29c63c5b service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:40 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-f35dcbec-743e-465d-8ef8-452459ada39e req-83880029-c514-4e9d-9d14-696c29c63c5b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:40 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-f35dcbec-743e-465d-8ef8-452459ada39e req-83880029-c514-4e9d-9d14-696c29c63c5b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:40 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-f35dcbec-743e-465d-8ef8-452459ada39e req-83880029-c514-4e9d-9d14-696c29c63c5b service nova] Creating event network-changed:535fdace-a2a4-4073-acaa-20534cfb3050 for instance 6c4fd3db-b881-441a-90b7-b927392288fb on user Apr 18 17:57:40 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-f35dcbec-743e-465d-8ef8-452459ada39e req-83880029-c514-4e9d-9d14-696c29c63c5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034976 Apr 18 17:57:40 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 83/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:40 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:41 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:41 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-2b3c0983-a892-4f5a-8725-98a393248e02 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.368968 Apr 18 17:57:41 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 79/238] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:40 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:41 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:41 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-ea8943a2-1362-4650-a399-2f9759532092 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.252229 Apr 18 17:57:41 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 77/239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:41 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:41 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:41 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-55fefce1-6722-49ea-ac7e-6dd989cfb107 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.156864 Apr 18 17:57:41 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 84/240] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:41 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] [instance: 06c6ec9c-bb35-4059-a18c-56fc998eb4e0] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] [instance: 06c6ec9c-bb35-4059-a18c-56fc998eb4e0] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:57:42 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-033df10a-d2bb-4e4e-abfc-29a11ab51826 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0" status: 204 len: 0 microversion: 2.1 time: 0.107871 Apr 18 17:57:42 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 80/241] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:57:42 2023] DELETE /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] [instance: 06c6ec9c-bb35-4059-a18c-56fc998eb4e0] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:42 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8490deab814653a759dbaf493f582a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68fd3d6d08674a8a830c500c6094b348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:57:42 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-8ba71fab-fd8f-42e9-b222-4d6c522764a7 tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0" status: 200 len: 1491 microversion: 2.1 time: 0.336145 Apr 18 17:57:42 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 78/242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:57:42 2023] GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0 => generated 1491 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:57:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-0eccff2f-16c4-42d6-b403-d3ab7ebb1e80 req-b08a6f50-1515-4f8c-a717-35d9e9f6f088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c6ec9c-bb35-4059-a18c-56fc998eb4e0", "name": "network-vif-unplugged", "status": "completed", "tag": "d7b0185b-dac8-4338-bef0-480925e8fbb7"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-0eccff2f-16c4-42d6-b403-d3ab7ebb1e80 req-b08a6f50-1515-4f8c-a717-35d9e9f6f088 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-0eccff2f-16c4-42d6-b403-d3ab7ebb1e80 req-b08a6f50-1515-4f8c-a717-35d9e9f6f088 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-0eccff2f-16c4-42d6-b403-d3ab7ebb1e80 req-b08a6f50-1515-4f8c-a717-35d9e9f6f088 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-0eccff2f-16c4-42d6-b403-d3ab7ebb1e80 req-b08a6f50-1515-4f8c-a717-35d9e9f6f088 service nova] Creating event network-vif-unplugged:d7b0185b-dac8-4338-bef0-480925e8fbb7 for instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 on user Apr 18 17:57:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-0eccff2f-16c4-42d6-b403-d3ab7ebb1e80 req-b08a6f50-1515-4f8c-a717-35d9e9f6f088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034900 Apr 18 17:57:42 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 85/243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-23957519-989d-4d56-83ac-9295235426c3 req-7a2fbf04-fd3d-4986-b029-3e92dd286de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4fd3db-b881-441a-90b7-b927392288fb", "name": "network-vif-plugged", "status": "completed", "tag": "535fdace-a2a4-4073-acaa-20534cfb3050"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-23957519-989d-4d56-83ac-9295235426c3 req-7a2fbf04-fd3d-4986-b029-3e92dd286de0 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-23957519-989d-4d56-83ac-9295235426c3 req-7a2fbf04-fd3d-4986-b029-3e92dd286de0 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:42 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-23957519-989d-4d56-83ac-9295235426c3 req-7a2fbf04-fd3d-4986-b029-3e92dd286de0 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:42 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-23957519-989d-4d56-83ac-9295235426c3 req-7a2fbf04-fd3d-4986-b029-3e92dd286de0 service nova] Creating event network-vif-plugged:535fdace-a2a4-4073-acaa-20534cfb3050 for instance 6c4fd3db-b881-441a-90b7-b927392288fb on user Apr 18 17:57:42 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-23957519-989d-4d56-83ac-9295235426c3 req-7a2fbf04-fd3d-4986-b029-3e92dd286de0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105373 Apr 18 17:57:42 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 81/244] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:44 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-d5000112-a868-460a-819b-3da56ad8f778 req-4215cb8f-bea4-4ee2-a3d9-2a9232936d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c6ec9c-bb35-4059-a18c-56fc998eb4e0", "name": "network-vif-plugged", "status": "completed", "tag": "d7b0185b-dac8-4338-bef0-480925e8fbb7"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:44 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:57:44 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-d5000112-a868-460a-819b-3da56ad8f778 req-4215cb8f-bea4-4ee2-a3d9-2a9232936d2e service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:44 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-d5000112-a868-460a-819b-3da56ad8f778 req-4215cb8f-bea4-4ee2-a3d9-2a9232936d2e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:44 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-d5000112-a868-460a-819b-3da56ad8f778 req-4215cb8f-bea4-4ee2-a3d9-2a9232936d2e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:44 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-d5000112-a868-460a-819b-3da56ad8f778 req-4215cb8f-bea4-4ee2-a3d9-2a9232936d2e service nova] Creating event network-vif-plugged:d7b0185b-dac8-4338-bef0-480925e8fbb7 for instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 on user Apr 18 17:57:44 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-d5000112-a868-460a-819b-3da56ad8f778 req-4215cb8f-bea4-4ee2-a3d9-2a9232936d2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034446 Apr 18 17:57:44 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 79/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:57:44 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-9c116998-f56b-40f2-8f9e-9c563af3d75f req-4a8bc80d-2770-43b3-8024-d4c1d7a8cb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4fd3db-b881-441a-90b7-b927392288fb", "name": "network-vif-plugged", "status": "completed", "tag": "535fdace-a2a4-4073-acaa-20534cfb3050"}, {"server_uuid": "06c6ec9c-bb35-4059-a18c-56fc998eb4e0", "name": "network-vif-deleted", "tag": "d7b0185b-dac8-4338-bef0-480925e8fbb7"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:57:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-9c116998-f56b-40f2-8f9e-9c563af3d75f req-4a8bc80d-2770-43b3-8024-d4c1d7a8cb1b service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:57:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-9c116998-f56b-40f2-8f9e-9c563af3d75f req-4a8bc80d-2770-43b3-8024-d4c1d7a8cb1b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:57:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-9c116998-f56b-40f2-8f9e-9c563af3d75f req-4a8bc80d-2770-43b3-8024-d4c1d7a8cb1b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:57:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-9c116998-f56b-40f2-8f9e-9c563af3d75f req-4a8bc80d-2770-43b3-8024-d4c1d7a8cb1b service nova] Creating event network-vif-plugged:535fdace-a2a4-4073-acaa-20534cfb3050 for instance 6c4fd3db-b881-441a-90b7-b927392288fb on user Apr 18 17:57:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-9c116998-f56b-40f2-8f9e-9c563af3d75f req-4a8bc80d-2770-43b3-8024-d4c1d7a8cb1b service nova] Creating event network-vif-deleted:d7b0185b-dac8-4338-bef0-480925e8fbb7 for instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 on user Apr 18 17:57:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-9c116998-f56b-40f2-8f9e-9c563af3d75f req-4a8bc80d-2770-43b3-8024-d4c1d7a8cb1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038125 Apr 18 17:57:44 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 86/246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:08 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-28cce043-4a88-4283-b1c9-7cb186ec3f99 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.196670 Apr 18 17:58:08 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 82/247] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 17:58:08 2023] GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62/os-interface => generated 283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:09 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:09 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=20 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:09 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:09 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-6ebdba3d-e7f2-46c1-96dd-d7220f94f2b1 req-dc056ec9-ca34-4c16-9677-e7bb0435e8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de60266-38a3-4baf-9b87-aaf7199edb62", "tag": "ec7942d2-08f9-428f-b5a4-8f4e831bb29c"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-6ebdba3d-e7f2-46c1-96dd-d7220f94f2b1 req-dc056ec9-ca34-4c16-9677-e7bb0435e8e1 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-6ebdba3d-e7f2-46c1-96dd-d7220f94f2b1 req-dc056ec9-ca34-4c16-9677-e7bb0435e8e1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-6ebdba3d-e7f2-46c1-96dd-d7220f94f2b1 req-dc056ec9-ca34-4c16-9677-e7bb0435e8e1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:09 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-6ebdba3d-e7f2-46c1-96dd-d7220f94f2b1 req-dc056ec9-ca34-4c16-9677-e7bb0435e8e1 service nova] Creating event network-changed:ec7942d2-08f9-428f-b5a4-8f4e831bb29c for instance 8de60266-38a3-4baf-9b87-aaf7199edb62 on user Apr 18 17:58:09 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-6ebdba3d-e7f2-46c1-96dd-d7220f94f2b1 req-dc056ec9-ca34-4c16-9677-e7bb0435e8e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100725 Apr 18 17:58:09 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 80/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:09 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-919ba8a9-2bcd-4a7a-8281-37ca6c9160ef tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62/ips" status: 200 len: 104 microversion: 2.1 time: 0.055658 Apr 18 17:58:09 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 87/249] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 17:58:09 2023] GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62/ips => generated 104 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:11 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:58:11 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-1a8acb5e-9bf6-43b4-9c31-3586ab00a329 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62" status: 204 len: 0 microversion: 2.1 time: 0.110298 Apr 18 17:58:11 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 83/250] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:58:11 2023] DELETE /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:11 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c167bb97deb24907a1fb757b13e0a840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfd165764d6457ba971b760fc1f6718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:11 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-36941ae1-d9c7-4330-9d1d-7e9dc85dd9aa tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62" status: 200 len: 1660 microversion: 2.1 time: 0.323942 Apr 18 17:58:11 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 81/251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:11 2023] GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 => generated 1660 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:58:11 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-c54f33b1-01f6-44d4-acb2-10d710e13cf5 req-69cff6af-a3b6-494b-aa68-ae1fae958b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de60266-38a3-4baf-9b87-aaf7199edb62", "name": "network-vif-unplugged", "status": "completed", "tag": "ec7942d2-08f9-428f-b5a4-8f4e831bb29c"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c54f33b1-01f6-44d4-acb2-10d710e13cf5 req-69cff6af-a3b6-494b-aa68-ae1fae958b0e service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c54f33b1-01f6-44d4-acb2-10d710e13cf5 req-69cff6af-a3b6-494b-aa68-ae1fae958b0e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c54f33b1-01f6-44d4-acb2-10d710e13cf5 req-69cff6af-a3b6-494b-aa68-ae1fae958b0e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:11 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-c54f33b1-01f6-44d4-acb2-10d710e13cf5 req-69cff6af-a3b6-494b-aa68-ae1fae958b0e service nova] Creating event network-vif-unplugged:ec7942d2-08f9-428f-b5a4-8f4e831bb29c for instance 8de60266-38a3-4baf-9b87-aaf7199edb62 on user Apr 18 17:58:11 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-c54f33b1-01f6-44d4-acb2-10d710e13cf5 req-69cff6af-a3b6-494b-aa68-ae1fae958b0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092175 Apr 18 17:58:11 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 88/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:13 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-8e675f87-1580-4be7-8956-dc428964dbd8 req-062b2922-66bf-4b03-8267-61eab0b7a9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de60266-38a3-4baf-9b87-aaf7199edb62", "name": "network-vif-deleted", "tag": "ec7942d2-08f9-428f-b5a4-8f4e831bb29c"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8e675f87-1580-4be7-8956-dc428964dbd8 req-062b2922-66bf-4b03-8267-61eab0b7a9f5 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8e675f87-1580-4be7-8956-dc428964dbd8 req-062b2922-66bf-4b03-8267-61eab0b7a9f5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8e675f87-1580-4be7-8956-dc428964dbd8 req-062b2922-66bf-4b03-8267-61eab0b7a9f5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-8e675f87-1580-4be7-8956-dc428964dbd8 req-062b2922-66bf-4b03-8267-61eab0b7a9f5 service nova] Creating event network-vif-deleted:ec7942d2-08f9-428f-b5a4-8f4e831bb29c for instance 8de60266-38a3-4baf-9b87-aaf7199edb62 on user Apr 18 17:58:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-8e675f87-1580-4be7-8956-dc428964dbd8 req-062b2922-66bf-4b03-8267-61eab0b7a9f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030748 Apr 18 17:58:13 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 84/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:13 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-46abd818-d8ae-4517-9095-d60594208ea4 req-fb28f466-ed7d-41cf-8dca-00890964ee4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de60266-38a3-4baf-9b87-aaf7199edb62", "name": "network-vif-plugged", "status": "completed", "tag": "ec7942d2-08f9-428f-b5a4-8f4e831bb29c"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-46abd818-d8ae-4517-9095-d60594208ea4 req-fb28f466-ed7d-41cf-8dca-00890964ee4e service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-46abd818-d8ae-4517-9095-d60594208ea4 req-fb28f466-ed7d-41cf-8dca-00890964ee4e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-46abd818-d8ae-4517-9095-d60594208ea4 req-fb28f466-ed7d-41cf-8dca-00890964ee4e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:13 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-46abd818-d8ae-4517-9095-d60594208ea4 req-fb28f466-ed7d-41cf-8dca-00890964ee4e service nova] Creating event network-vif-plugged:ec7942d2-08f9-428f-b5a4-8f4e831bb29c for instance 8de60266-38a3-4baf-9b87-aaf7199edb62 on user Apr 18 17:58:13 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-46abd818-d8ae-4517-9095-d60594208ea4 req-fb28f466-ed7d-41cf-8dca-00890964ee4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033560 Apr 18 17:58:13 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 89/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:13 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1778018883"}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:13 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:14 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-aa00dc10-8747-4500-a472-9547ad112478 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5/action" status: 202 len: 52 microversion: 2.87 time: 0.849687 Apr 18 17:58:14 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 82/255] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 17:58:13 2023] POST /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5/action => generated 52 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:16 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:16 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-fce21158-4a7c-4f09-a54d-60f662ed1f7a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0" status: 200 len: 1537 microversion: 2.1 time: 0.276765 Apr 18 17:58:16 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 85/256] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:16 2023] GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Searching by: {'deleted': False, 'project_id': 'af34eaf8745141928f32aab84e7264b6'} {{(pid=61068) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:16 user devstack@n-api.service[61068]: DEBUG nova.compute.multi_cell_list [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61068) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 17:58:17 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-c8c5e6f6-b51f-42f1-a8e1-d8c7dd0107ab tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.182924 Apr 18 17:58:17 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 90/257] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 17:58:16 2023] GET /compute/v2.1/servers => generated 341 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:17 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:17 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-1ad02bc4-3a2f-48d1-bfd1-31646013e55a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0" status: 200 len: 1537 microversion: 2.1 time: 0.213608 Apr 18 17:58:17 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 83/258] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:17 2023] GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 => generated 1537 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:18 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:58:18 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-94044b4a-0a8a-4774-b919-cb8a009f662a tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0" status: 204 len: 0 microversion: 2.1 time: 0.121147 Apr 18 17:58:18 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 86/259] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:58:18 2023] DELETE /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:18 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:19 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f250508b0762464ebf52fc73f1f49ac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af34eaf8745141928f32aab84e7264b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:19 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-bc35b437-55a5-4fb9-8996-7f505e6efb5f tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0" status: 200 len: 1543 microversion: 2.1 time: 0.166311 Apr 18 17:58:19 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 91/260] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:18 2023] GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 => generated 1543 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:58:19 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-71d777f2-f039-4ac0-b60b-f5e1c41b0a0d req-a5e8d19b-e6b6-410f-9afe-4bf88f3f4a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fc340-ffc6-48d3-a32d-312bf1b162b0", "name": "network-vif-unplugged", "status": "completed", "tag": "7449de31-9caf-40bd-b53d-1aae3df449a9"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:19 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-71d777f2-f039-4ac0-b60b-f5e1c41b0a0d req-a5e8d19b-e6b6-410f-9afe-4bf88f3f4a48 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:19 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-71d777f2-f039-4ac0-b60b-f5e1c41b0a0d req-a5e8d19b-e6b6-410f-9afe-4bf88f3f4a48 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:19 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-71d777f2-f039-4ac0-b60b-f5e1c41b0a0d req-a5e8d19b-e6b6-410f-9afe-4bf88f3f4a48 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:19 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-71d777f2-f039-4ac0-b60b-f5e1c41b0a0d req-a5e8d19b-e6b6-410f-9afe-4bf88f3f4a48 service nova] Creating event network-vif-unplugged:7449de31-9caf-40bd-b53d-1aae3df449a9 for instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 on user Apr 18 17:58:19 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-71d777f2-f039-4ac0-b60b-f5e1c41b0a0d req-a5e8d19b-e6b6-410f-9afe-4bf88f3f4a48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029300 Apr 18 17:58:19 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 84/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:20 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:20 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:20 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:20 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-049be149-4cbe-49e1-9671-4af9a1113f92 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5" status: 200 len: 1691 microversion: 2.87 time: 0.235954 Apr 18 17:58:20 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 87/262] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:58:19 2023] GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:58:20 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-c1caa16d-2722-428b-a224-82573935127f req-3d99e06c-40a6-47c5-96eb-8057042f6264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fc340-ffc6-48d3-a32d-312bf1b162b0", "name": "network-vif-deleted", "tag": "7449de31-9caf-40bd-b53d-1aae3df449a9"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:20 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c1caa16d-2722-428b-a224-82573935127f req-3d99e06c-40a6-47c5-96eb-8057042f6264 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:20 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c1caa16d-2722-428b-a224-82573935127f req-3d99e06c-40a6-47c5-96eb-8057042f6264 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:20 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c1caa16d-2722-428b-a224-82573935127f req-3d99e06c-40a6-47c5-96eb-8057042f6264 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:20 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-c1caa16d-2722-428b-a224-82573935127f req-3d99e06c-40a6-47c5-96eb-8057042f6264 service nova] Creating event network-vif-deleted:7449de31-9caf-40bd-b53d-1aae3df449a9 for instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 on user Apr 18 17:58:20 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-c1caa16d-2722-428b-a224-82573935127f req-3d99e06c-40a6-47c5-96eb-8057042f6264 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039834 Apr 18 17:58:20 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 92/263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-922d0695-1be4-4dba-82cb-5f1138d37924 req-0819ebbc-8a4b-4e50-bdc4-8474487c94a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127fc340-ffc6-48d3-a32d-312bf1b162b0", "name": "network-vif-plugged", "status": "completed", "tag": "7449de31-9caf-40bd-b53d-1aae3df449a9"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-922d0695-1be4-4dba-82cb-5f1138d37924 req-0819ebbc-8a4b-4e50-bdc4-8474487c94a9 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-922d0695-1be4-4dba-82cb-5f1138d37924 req-0819ebbc-8a4b-4e50-bdc4-8474487c94a9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-922d0695-1be4-4dba-82cb-5f1138d37924 req-0819ebbc-8a4b-4e50-bdc4-8474487c94a9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-922d0695-1be4-4dba-82cb-5f1138d37924 req-0819ebbc-8a4b-4e50-bdc4-8474487c94a9 service nova] Creating event network-vif-plugged:7449de31-9caf-40bd-b53d-1aae3df449a9 for instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 on user Apr 18 17:58:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-922d0695-1be4-4dba-82cb-5f1138d37924 req-0819ebbc-8a4b-4e50-bdc4-8474487c94a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030661 Apr 18 17:58:21 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 85/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: 096bd7aa-fce5-49a2-9514-d559ce6657fe] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] HTTP exception thrown: Instance 096bd7aa-fce5-49a2-9514-d559ce6657fe could not be found. Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Request method failure captured: Apr 18 17:58:21 user devstack@n-api.service[61069]: request: GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe HTTP/1.1 Apr 18 17:58:21 user devstack@n-api.service[61069]: Accept: application/json Apr 18 17:58:21 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 17:58:21 user devstack@n-api.service[61069]: Connection: close Apr 18 17:58:21 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 17:58:21 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 17:58:21 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 17:58:21 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 17:58:21 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtjmVsZ3M-_TPQvjK54FpYJd5mehSLUi1se-lwDfraFkUVe1wwuaNvc7-FcipckJiNgX-x2JHuUkvRBBItUjipxG5GtUog9cMfDNoX6ksLgm_xfxaOdOXAn3F2AGnPbiWQyFNQLC1U10Id3eeqRQedVEx2pLSQY-C2i265QJhNtlXdQ Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Project-Id: 1c689d1535d74fb98276764e48bae128 Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1221245516 Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c689d1535d74fb98276764e48bae128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c689d1535d74fb98276764e48bae128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c689d1535d74fb98276764e48bae128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1221245516 Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Tenant-Id: 1c689d1535d74fb98276764e48bae128 Apr 18 17:58:21 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1221245516 Apr 18 17:58:21 user devstack@n-api.service[61069]: X-User: tempest-ServerRescueNegativeTestJSON-1221245516-project-member Apr 18 17:58:21 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 17:58:21 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 17:58:21 user devstack@n-api.service[61069]: X-User-Id: eae8860750104207a580da9d4020e31e Apr 18 17:58:21 user devstack@n-api.service[61069]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1221245516-project-member Apr 18 17:58:21 user devstack@n-api.service[61069]: method: > Apr 18 17:58:21 user devstack@n-api.service[61069]: exception: Instance 096bd7aa-fce5-49a2-9514-d559ce6657fe could not be found. Apr 18 17:58:21 user devstack@n-api.service[61069]: action_args: {'id': '096bd7aa-fce5-49a2-9514-d559ce6657fe'} Apr 18 17:58:21 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096bd7aa-fce5-49a2-9514-d559ce6657fe could not be found. Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096bd7aa-fce5-49a2-9514-d559ce6657fe could not be found. Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096bd7aa-fce5-49a2-9514-d559ce6657fe could not be found. Apr 18 17:58:21 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Returning 404 to user: Instance 096bd7aa-fce5-49a2-9514-d559ce6657fe could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:58:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-d4c157fb-6559-4481-9f7b-9100abe94a03 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe" status: 404 len: 111 microversion: 2.1 time: 0.120808 Apr 18 17:58:21 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:21 2023] GET /compute/v2.1/servers/096bd7aa-fce5-49a2-9514-d559ce6657fe => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: d60955fa-c17f-4588-8348-2b8f5991564d] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: d60955fa-c17f-4588-8348-2b8f5991564d] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:58:21 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-126cb10e-be18-4a7c-99c6-1c88593e123a tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d" status: 204 len: 0 microversion: 2.1 time: 0.105974 Apr 18 17:58:21 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 93/266] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:58:21 2023] DELETE /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: d60955fa-c17f-4588-8348-2b8f5991564d] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae8860750104207a580da9d4020e31e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c689d1535d74fb98276764e48bae128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-8ca08963-e623-44d1-a1ca-1cdfb8eb1ea5 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d" status: 200 len: 1511 microversion: 2.1 time: 0.313014 Apr 18 17:58:21 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 86/267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:21 2023] GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-b0e7c7bf-ff39-4a6f-ad9d-e3061334bc49 req-3960eeed-ceae-4d9b-a074-9b35b28dfef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-unplugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-b0e7c7bf-ff39-4a6f-ad9d-e3061334bc49 req-3960eeed-ceae-4d9b-a074-9b35b28dfef1 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-b0e7c7bf-ff39-4a6f-ad9d-e3061334bc49 req-3960eeed-ceae-4d9b-a074-9b35b28dfef1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:21 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-b0e7c7bf-ff39-4a6f-ad9d-e3061334bc49 req-3960eeed-ceae-4d9b-a074-9b35b28dfef1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-b0e7c7bf-ff39-4a6f-ad9d-e3061334bc49 req-3960eeed-ceae-4d9b-a074-9b35b28dfef1 service nova] Creating event network-vif-unplugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:58:21 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-b0e7c7bf-ff39-4a6f-ad9d-e3061334bc49 req-3960eeed-ceae-4d9b-a074-9b35b28dfef1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038627 Apr 18 17:58:21 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 89/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-dff6180d-836f-4269-b7d9-c43563211ff2 req-5992488d-c478-4ef1-bb72-de947850d762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-deleted", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-dff6180d-836f-4269-b7d9-c43563211ff2 req-5992488d-c478-4ef1-bb72-de947850d762 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-dff6180d-836f-4269-b7d9-c43563211ff2 req-5992488d-c478-4ef1-bb72-de947850d762 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-dff6180d-836f-4269-b7d9-c43563211ff2 req-5992488d-c478-4ef1-bb72-de947850d762 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-dff6180d-836f-4269-b7d9-c43563211ff2 req-5992488d-c478-4ef1-bb72-de947850d762 service nova] Creating event network-vif-deleted:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-dff6180d-836f-4269-b7d9-c43563211ff2 req-5992488d-c478-4ef1-bb72-de947850d762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037087 Apr 18 17:58:23 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 94/269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: b85d00fa-2bb6-4a4e-b424-aacb039caffc] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:23 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] HTTP exception thrown: Instance b85d00fa-2bb6-4a4e-b424-aacb039caffc could not be found. Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Request method failure captured: Apr 18 17:58:23 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc HTTP/1.1 Apr 18 17:58:23 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:58:23 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:58:23 user devstack@n-api.service[61070]: Connection: close Apr 18 17:58:23 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 17:58:23 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:58:23 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:58:23 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:58:23 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtkfjY2Q1lqbzkQnL9-Dy5qNR1LqDyqI1THrGDH31aWEOwRLv3tsZ82QAT_ZHWB4wf85CqKA8ENmA4toxP-E3ilQBaA3mYEX89Cx6k0lDCSLL2zgRZprgYGmu12CFoSqnW40SKg35bCXIU0gfUVvbM96FtowrEODEnru9JPYPqcwZzE Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Project-Id: 84c8ef9ed106494081b51a6bccc144a6 Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Project-Name: tempest-VolumesAdminNegativeTest-815900507 Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84c8ef9ed106494081b51a6bccc144a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84c8ef9ed106494081b51a6bccc144a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/84c8ef9ed106494081b51a6bccc144a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Tenant: tempest-VolumesAdminNegativeTest-815900507 Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Tenant-Id: 84c8ef9ed106494081b51a6bccc144a6 Apr 18 17:58:23 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-815900507 Apr 18 17:58:23 user devstack@n-api.service[61070]: X-User: tempest-VolumesAdminNegativeTest-815900507-project-member Apr 18 17:58:23 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:58:23 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:58:23 user devstack@n-api.service[61070]: X-User-Id: 468cf6197f4a4d49b3a58255e999bf9e Apr 18 17:58:23 user devstack@n-api.service[61070]: X-User-Name: tempest-VolumesAdminNegativeTest-815900507-project-member Apr 18 17:58:23 user devstack@n-api.service[61070]: method: > Apr 18 17:58:23 user devstack@n-api.service[61070]: exception: Instance b85d00fa-2bb6-4a4e-b424-aacb039caffc could not be found. Apr 18 17:58:23 user devstack@n-api.service[61070]: action_args: {'id': 'b85d00fa-2bb6-4a4e-b424-aacb039caffc'} Apr 18 17:58:23 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85d00fa-2bb6-4a4e-b424-aacb039caffc could not be found. Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85d00fa-2bb6-4a4e-b424-aacb039caffc could not be found. Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85d00fa-2bb6-4a4e-b424-aacb039caffc could not be found. Apr 18 17:58:23 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:58:23 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Returning 404 to user: Instance b85d00fa-2bb6-4a4e-b424-aacb039caffc could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:58:23 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-dd52f81c-0365-4af9-8e58-4b68dc0510cc tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc" status: 404 len: 111 microversion: 2.1 time: 0.043336 Apr 18 17:58:23 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 87/270] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:23 2023] GET /compute/v2.1/servers/b85d00fa-2bb6-4a4e-b424-aacb039caffc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:23 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-plugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}, {"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-plugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}, {"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-plugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}, {"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-unplugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}, {"server_uuid": "d60955fa-c17f-4588-8348-2b8f5991564d", "name": "network-vif-plugged", "status": "completed", "tag": "44f92548-c2e0-40b8-a184-ea0fc18e7435"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:23 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Creating event network-vif-plugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Creating event network-vif-plugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Creating event network-vif-plugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Creating event network-vif-unplugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] Creating event network-vif-plugged:44f92548-c2e0-40b8-a184-ea0fc18e7435 for instance d60955fa-c17f-4588-8348-2b8f5991564d on user Apr 18 17:58:23 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-5c941f6f-d077-4bea-b66e-1590e3d41fef req-ff894f89-58b3-44aa-922b-1831d75f4201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031878 Apr 18 17:58:23 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 95/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:23 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:24 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-523cad40-10d4-4bfc-be94-bfb4a5140929 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969" status: 204 len: 0 microversion: 2.1 time: 0.111088 Apr 18 17:58:24 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 90/272] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 17:58:23 2023] DELETE /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:24 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468cf6197f4a4d49b3a58255e999bf9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c8ef9ed106494081b51a6bccc144a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:24 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-df9db6db-a7fb-4f71-ad77-843d76ca6a47 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969" status: 200 len: 1668 microversion: 2.1 time: 0.241735 Apr 18 17:58:24 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 88/273] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:24 2023] GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969 => generated 1668 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:58:25 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-unplugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}, {"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-plugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}, {"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-plugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:25 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:25 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:25 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:25 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] Creating event network-vif-unplugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:58:25 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] Creating event network-vif-plugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:58:25 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] Creating event network-vif-plugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:58:25 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-ca87028f-a569-4fe1-bbcb-0c7d8a7d5be6 req-3a212444-a050-4f86-9e58-b9ac371b5b35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034820 Apr 18 17:58:25 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 96/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:25 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:27 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-plugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}, {"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-unplugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}, {"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-plugged", "status": "completed", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}, {"server_uuid": "a6133da6-009d-478a-97d5-17f345a33969", "name": "network-vif-deleted", "tag": "b4986795-4a27-4cf6-9012-4b72d1781a36"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:58:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Creating event network-vif-plugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:58:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Creating event network-vif-unplugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:58:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Creating event network-vif-plugged:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:58:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] Creating event network-vif-deleted:b4986795-4a27-4cf6-9012-4b72d1781a36 for instance a6133da6-009d-478a-97d5-17f345a33969 on user Apr 18 17:58:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-2d780763-d885-4a1c-a634-ffc20dae1973 req-88c743c8-7207-44bb-a13e-fb24289aba48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.038906 Apr 18 17:58:27 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 91/275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:27 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:27 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-22e67f2a-529a-4259-ab5d-1763e9a0cbba tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 200 len: 1491 microversion: 2.1 time: 0.304776 Apr 18 17:58:27 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 89/276] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:27 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 1491 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] [instance: 06c6ec9c-bb35-4059-a18c-56fc998eb4e0] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] HTTP exception thrown: Instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 could not be found. Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Request method failure captured: Apr 18 17:58:32 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0 HTTP/1.1 Apr 18 17:58:32 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:58:32 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:58:32 user devstack@n-api.service[61068]: Connection: close Apr 18 17:58:32 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 17:58:32 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:58:32 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:58:32 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:58:32 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtmisgzIcxQ2S6HeG_uMUWT1V78sM229jaoP-VJQS_EfAGwe-mi5Gy-_Fu-54NY3GqVcgGesUBVSASrxP48X1vPWt2TqyQFRq8hCW45Jvoz0P_u8RCjtbPiHOwPfdWzr6tfcGOtYWFXoFWSuDY7Hj1okQdR5fXkzx13xmfxp37bFSkg Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Project-Id: 68fd3d6d08674a8a830c500c6094b348 Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Project-Name: tempest-VolumesActionsTest-1046475529 Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68fd3d6d08674a8a830c500c6094b348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/68fd3d6d08674a8a830c500c6094b348"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/68fd3d6d08674a8a830c500c6094b348"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Tenant: tempest-VolumesActionsTest-1046475529 Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Tenant-Id: 68fd3d6d08674a8a830c500c6094b348 Apr 18 17:58:32 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-VolumesActionsTest-1046475529 Apr 18 17:58:32 user devstack@n-api.service[61068]: X-User: tempest-VolumesActionsTest-1046475529-project-member Apr 18 17:58:32 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:58:32 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:58:32 user devstack@n-api.service[61068]: X-User-Id: ed8490deab814653a759dbaf493f582a Apr 18 17:58:32 user devstack@n-api.service[61068]: X-User-Name: tempest-VolumesActionsTest-1046475529-project-member Apr 18 17:58:32 user devstack@n-api.service[61068]: method: > Apr 18 17:58:32 user devstack@n-api.service[61068]: exception: Instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 could not be found. Apr 18 17:58:32 user devstack@n-api.service[61068]: action_args: {'id': '06c6ec9c-bb35-4059-a18c-56fc998eb4e0'} Apr 18 17:58:32 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 could not be found. Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 could not be found. Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 could not be found. Apr 18 17:58:32 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:58:32 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] Returning 404 to user: Instance 06c6ec9c-bb35-4059-a18c-56fc998eb4e0 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:58:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-dac87e46-2c7b-40a7-beeb-71ece566d4bf tempest-VolumesActionsTest-1046475529 tempest-VolumesActionsTest-1046475529-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0" status: 404 len: 111 microversion: 2.1 time: 0.030627 Apr 18 17:58:32 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 97/277] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:32 2023] GET /compute/v2.1/servers/06c6ec9c-bb35-4059-a18c-56fc998eb4e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:58:43 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:58:43 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-a7b38b0f-e421-480b-96f5-714a783e01e6 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.250402 Apr 18 17:58:43 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 92/278] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:58:43 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=20 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] HTTP exception thrown: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Request method failure captured: Apr 18 17:59:01 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 HTTP/1.1 Apr 18 17:59:01 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:59:01 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:59:01 user devstack@n-api.service[61070]: Connection: close Apr 18 17:59:01 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 17:59:01 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:59:01 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:59:01 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:59:01 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtm-FFuk3p45mxd3v9ZjCV8cnHa0-u7-bbTrhXolV7dsSYiNB750hkk9B3jts6eA_mJaT9Iw2oei3qP_ZCy6atcCB4gllWjc6kepp_w4oOZ5Dh8LSulVVTg9DNksD69qtA7YsX6JwC_8nR2O2FPYa2jY3OPRqhFbFxodCH2XPiqvNYQ Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Project-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeTestJSON-709288454 Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Tenant-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 17:59:01 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 17:59:01 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 17:59:01 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:59:01 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:59:01 user devstack@n-api.service[61070]: X-User-Id: c167bb97deb24907a1fb757b13e0a840 Apr 18 17:59:01 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 17:59:01 user devstack@n-api.service[61070]: method: > Apr 18 17:59:01 user devstack@n-api.service[61070]: exception: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 17:59:01 user devstack@n-api.service[61070]: action_args: {'id': '8de60266-38a3-4baf-9b87-aaf7199edb62'} Apr 18 17:59:01 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 17:59:01 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:01 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Returning 404 to user: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:59:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-193eea6e-5929-4884-aa94-439eaa0028ac tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62" status: 404 len: 111 microversion: 2.1 time: 0.040329 Apr 18 17:59:01 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 90/279] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:01 2023] GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:59:01 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-8a9a3916-a06a-4bbc-a65a-1233a5adaa64 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '.version_select at 0x7fb35b16f370>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:01 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:01 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:02 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-8a9a3916-a06a-4bbc-a65a-1233a5adaa64 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890549411" status: 202 len: 0 microversion: 2.1 time: 0.189791 Apr 18 17:59:02 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 98/280] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 17:59:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890549411 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:59:02 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-be80d875-b279-4780-a00c-795c452a266e tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Action: 'create', calling method: .version_select at 0x7fb35b0ae830>, body: {"keypair": {"name": "tempest-keypair-1475602808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME0alYswKXq6MtzqbDmLMTDBFmbkFyzQOOpLPrk17QOsOMHyCPNjQt8duAqCKVThSEOwEaMaaU1GITTfay6VQWyy38cRGo9om5knVAYqVkTFg7jB7vNxHMCvHC6XTq5zw=="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:02 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:02 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:02 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-be80d875-b279-4780-a00c-795c452a266e tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for project fbfd165764d6457ba971b760fc1f6718. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:59:02 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-be80d875-b279-4780-a00c-795c452a266e tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for user c167bb97deb24907a1fb757b13e0a840 and project fbfd165764d6457ba971b760fc1f6718. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:59:02 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-be80d875-b279-4780-a00c-795c452a266e tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062761 Apr 18 17:59:02 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 93/281] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:59:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:04 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-233126300", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "349cb244-24d7-4014-8bdf-ec2dbc00aed5"}], "security_groups": [{"name": "tempest-securitygroup--864647903"}], "key_name": "tempest-keypair-1475602808", "user_data": "}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:04 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] validate_networks() for [('349cb244-24d7-4014-8bdf-ec2dbc00aed5', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for project fbfd165764d6457ba971b760fc1f6718. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Getting quotas for user c167bb97deb24907a1fb757b13e0a840 and project fbfd165764d6457ba971b760fc1f6718. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:59:05 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:59:05 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-71431a43-b613-4baf-ad04-eb0d932ac733 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.318172 Apr 18 17:59:05 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 91/282] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:59:04 2023] POST /compute/v2.1/servers => generated 399 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:59:05 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-8e8a97c7-7f2f-4bb9-88da-8c5b18a4d46b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:05 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-8e8a97c7-7f2f-4bb9-88da-8c5b18a4d46b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:05 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-8e8a97c7-7f2f-4bb9-88da-8c5b18a4d46b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c167bb97deb24907a1fb757b13e0a840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfd165764d6457ba971b760fc1f6718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:05 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-8e8a97c7-7f2f-4bb9-88da-8c5b18a4d46b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814" status: 200 len: 1231 microversion: 2.1 time: 0.076780 Apr 18 17:59:05 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 99/283] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:05 2023] GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 => generated 1231 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:59:08 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-986ebe81-a97e-4beb-a92b-648d6b0cd331 req-53f95f5c-8367-498c-8373-087fcfa3701e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d85bcc-3afe-4457-8975-18ff2395b814", "tag": "5ce5f67e-29f3-4ec1-a9f8-734b47f192e8"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-986ebe81-a97e-4beb-a92b-648d6b0cd331 req-53f95f5c-8367-498c-8373-087fcfa3701e service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-986ebe81-a97e-4beb-a92b-648d6b0cd331 req-53f95f5c-8367-498c-8373-087fcfa3701e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:08 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-986ebe81-a97e-4beb-a92b-648d6b0cd331 req-53f95f5c-8367-498c-8373-087fcfa3701e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:08 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-986ebe81-a97e-4beb-a92b-648d6b0cd331 req-53f95f5c-8367-498c-8373-087fcfa3701e service nova] Creating event network-changed:5ce5f67e-29f3-4ec1-a9f8-734b47f192e8 for instance 39d85bcc-3afe-4457-8975-18ff2395b814 on user Apr 18 17:59:08 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-986ebe81-a97e-4beb-a92b-648d6b0cd331 req-53f95f5c-8367-498c-8373-087fcfa3701e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034650 Apr 18 17:59:08 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 94/284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] [instance: 127fc340-ffc6-48d3-a32d-312bf1b162b0] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:09 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] HTTP exception thrown: Instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 could not be found. Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Request method failure captured: Apr 18 17:59:09 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 HTTP/1.1 Apr 18 17:59:09 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:59:09 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:59:09 user devstack@n-api.service[61070]: Connection: close Apr 18 17:59:09 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 17:59:09 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:59:09 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:59:09 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:59:09 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtkSDN3Y_YlPZdMPnFGYm9jU8qb-OfvGbElesvmC56fG-5Yhj0xwgWnqozk5LM91u5OTKzFqEFD1ufccgEnkSpnEFXcSl5eGyy0eNX9yL-f7zW-8mc5JJojW4WvFtQaJuRKnq6--XHbZvEinPsdxJSRvHLKgDhQzluD7-1D2tmHyXZ4 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Project-Id: af34eaf8745141928f32aab84e7264b6 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Project-Name: tempest-TestMinimumBasicScenario-796860875 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34eaf8745141928f32aab84e7264b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af34eaf8745141928f32aab84e7264b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af34eaf8745141928f32aab84e7264b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Tenant: tempest-TestMinimumBasicScenario-796860875 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Tenant-Id: af34eaf8745141928f32aab84e7264b6 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-TestMinimumBasicScenario-796860875 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-User: tempest-TestMinimumBasicScenario-796860875-project-member Apr 18 17:59:09 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:59:09 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:59:09 user devstack@n-api.service[61070]: X-User-Id: f250508b0762464ebf52fc73f1f49ac8 Apr 18 17:59:09 user devstack@n-api.service[61070]: X-User-Name: tempest-TestMinimumBasicScenario-796860875-project-member Apr 18 17:59:09 user devstack@n-api.service[61070]: method: > Apr 18 17:59:09 user devstack@n-api.service[61070]: exception: Instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 could not be found. Apr 18 17:59:09 user devstack@n-api.service[61070]: action_args: {'id': '127fc340-ffc6-48d3-a32d-312bf1b162b0'} Apr 18 17:59:09 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 could not be found. Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 could not be found. Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 could not be found. Apr 18 17:59:09 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:09 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Returning 404 to user: Instance 127fc340-ffc6-48d3-a32d-312bf1b162b0 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:59:09 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-42cfac36-11e1-4c97-a163-89ae9c6e2727 tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0" status: 404 len: 111 microversion: 2.1 time: 0.186160 Apr 18 17:59:09 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 92/285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:09 2023] GET /compute/v2.1/servers/127fc340-ffc6-48d3-a32d-312bf1b162b0 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:59:09 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-b13f359b-f4fd-41d1-88f3-623acfaa41ce tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] Calling method '.version_select at 0x7fb35b16d870>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:09 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-b13f359b-f4fd-41d1-88f3-623acfaa41ce tempest-TestMinimumBasicScenario-796860875 tempest-TestMinimumBasicScenario-796860875-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1708263975" status: 202 len: 0 microversion: 2.1 time: 0.032864 Apr 18 17:59:09 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 100/286] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 17:59:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1708263975 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:59:11 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-f421364d-0c52-4fbf-b83e-60ee542620ec req-12cb5ae1-0e74-4e1d-8c78-165080ef9ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d85bcc-3afe-4457-8975-18ff2395b814", "name": "network-vif-plugged", "status": "completed", "tag": "5ce5f67e-29f3-4ec1-a9f8-734b47f192e8"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-f421364d-0c52-4fbf-b83e-60ee542620ec req-12cb5ae1-0e74-4e1d-8c78-165080ef9ef3 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-f421364d-0c52-4fbf-b83e-60ee542620ec req-12cb5ae1-0e74-4e1d-8c78-165080ef9ef3 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:11 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-f421364d-0c52-4fbf-b83e-60ee542620ec req-12cb5ae1-0e74-4e1d-8c78-165080ef9ef3 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:11 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-f421364d-0c52-4fbf-b83e-60ee542620ec req-12cb5ae1-0e74-4e1d-8c78-165080ef9ef3 service nova] Creating event network-vif-plugged:5ce5f67e-29f3-4ec1-a9f8-734b47f192e8 for instance 39d85bcc-3afe-4457-8975-18ff2395b814 on user Apr 18 17:59:11 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-f421364d-0c52-4fbf-b83e-60ee542620ec req-12cb5ae1-0e74-4e1d-8c78-165080ef9ef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031814 Apr 18 17:59:11 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 95/287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:11 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-d7b5dff2-64ff-4fa2-bb22-997e08ed009e tempest-TestVolumeBootPattern-834560167 tempest-TestVolumeBootPattern-834560167-project-member] Action: 'create', calling method: .version_select at 0x7fb35b266d40>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-875210495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOyHHwZ8sz6CSBje/gTSbG/niJ1jStNL8kHcJywK/M/UN27OnKvNr2s7xPqIKIEmlrRcpwEEXhv1I203Q3P1je/k93j/JC1q5wped9JeBvQnFeCOJfluTaroHdPvExCBQ=="}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:11 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-d7b5dff2-64ff-4fa2-bb22-997e08ed009e tempest-TestVolumeBootPattern-834560167 tempest-TestVolumeBootPattern-834560167-project-member] Getting quotas for project 679a19b0728c49f680152cedbfbe0028. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:59:11 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-d7b5dff2-64ff-4fa2-bb22-997e08ed009e tempest-TestVolumeBootPattern-834560167 tempest-TestVolumeBootPattern-834560167-project-member] Getting quotas for user a3a8b63cf46e44e195cce03bab3d87b5 and project 679a19b0728c49f680152cedbfbe0028. Resources: {'key_pairs'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:59:11 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-d7b5dff2-64ff-4fa2-bb22-997e08ed009e tempest-TestVolumeBootPattern-834560167 tempest-TestVolumeBootPattern-834560167-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.049905 Apr 18 17:59:11 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 93/288] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 17:59:11 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] [instance: d60955fa-c17f-4588-8348-2b8f5991564d] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:12 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] HTTP exception thrown: Instance d60955fa-c17f-4588-8348-2b8f5991564d could not be found. Apr 18 17:59:12 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Request method failure captured: Apr 18 17:59:12 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d HTTP/1.1 Apr 18 17:59:12 user devstack@n-api.service[61068]: Accept: application/json Apr 18 17:59:12 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 17:59:12 user devstack@n-api.service[61068]: Connection: close Apr 18 17:59:12 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 17:59:12 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 17:59:12 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 17:59:12 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 17:59:12 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjmVsZ3M-_TPQvjK54FpYJd5mehSLUi1se-lwDfraFkUVe1wwuaNvc7-FcipckJiNgX-x2JHuUkvRBBItUjipxG5GtUog9cMfDNoX6ksLgm_xfxaOdOXAn3F2AGnPbiWQyFNQLC1U10Id3eeqRQedVEx2pLSQY-C2i265QJhNtlXdQ Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Project-Id: 1c689d1535d74fb98276764e48bae128 Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1221245516 Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c689d1535d74fb98276764e48bae128"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1c689d1535d74fb98276764e48bae128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1c689d1535d74fb98276764e48bae128"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1221245516 Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Tenant-Id: 1c689d1535d74fb98276764e48bae128 Apr 18 17:59:12 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1221245516 Apr 18 17:59:12 user devstack@n-api.service[61068]: X-User: tempest-ServerRescueNegativeTestJSON-1221245516-project-member Apr 18 17:59:12 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 17:59:12 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 17:59:12 user devstack@n-api.service[61068]: X-User-Id: eae8860750104207a580da9d4020e31e Apr 18 17:59:12 user devstack@n-api.service[61068]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1221245516-project-member Apr 18 17:59:12 user devstack@n-api.service[61068]: method: > Apr 18 17:59:12 user devstack@n-api.service[61068]: exception: Instance d60955fa-c17f-4588-8348-2b8f5991564d could not be found. Apr 18 17:59:12 user devstack@n-api.service[61068]: action_args: {'id': 'd60955fa-c17f-4588-8348-2b8f5991564d'} Apr 18 17:59:12 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60955fa-c17f-4588-8348-2b8f5991564d could not be found. Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60955fa-c17f-4588-8348-2b8f5991564d could not be found. Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60955fa-c17f-4588-8348-2b8f5991564d could not be found. Apr 18 17:59:12 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 17:59:12 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] Returning 404 to user: Instance d60955fa-c17f-4588-8348-2b8f5991564d could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:59:12 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-0258ef1f-1e00-4f57-b11a-1566e881ffa2 tempest-ServerRescueNegativeTestJSON-1221245516 tempest-ServerRescueNegativeTestJSON-1221245516-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d" status: 404 len: 111 microversion: 2.1 time: 0.040668 Apr 18 17:59:12 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 101/289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:11 2023] GET /compute/v2.1/servers/d60955fa-c17f-4588-8348-2b8f5991564d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:59:13 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-e2c2fc03-aa24-4824-914a-904163bbd4d8 req-dec4b6af-9b18-4384-a6a7-d9e4cc538b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d85bcc-3afe-4457-8975-18ff2395b814", "name": "network-vif-plugged", "status": "completed", "tag": "5ce5f67e-29f3-4ec1-a9f8-734b47f192e8"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:13 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=4 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e2c2fc03-aa24-4824-914a-904163bbd4d8 req-dec4b6af-9b18-4384-a6a7-d9e4cc538b8e service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e2c2fc03-aa24-4824-914a-904163bbd4d8 req-dec4b6af-9b18-4384-a6a7-d9e4cc538b8e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e2c2fc03-aa24-4824-914a-904163bbd4d8 req-dec4b6af-9b18-4384-a6a7-d9e4cc538b8e service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-e2c2fc03-aa24-4824-914a-904163bbd4d8 req-dec4b6af-9b18-4384-a6a7-d9e4cc538b8e service nova] Creating event network-vif-plugged:5ce5f67e-29f3-4ec1-a9f8-734b47f192e8 for instance 39d85bcc-3afe-4457-8975-18ff2395b814 on user Apr 18 17:59:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-e2c2fc03-aa24-4824-914a-904163bbd4d8 req-dec4b6af-9b18-4384-a6a7-d9e4cc538b8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050535 Apr 18 17:59:13 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 96/290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] [instance: a6133da6-009d-478a-97d5-17f345a33969] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:14 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] HTTP exception thrown: Instance a6133da6-009d-478a-97d5-17f345a33969 could not be found. Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Request method failure captured: Apr 18 17:59:14 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969 HTTP/1.1 Apr 18 17:59:14 user devstack@n-api.service[61070]: Accept: application/json Apr 18 17:59:14 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 17:59:14 user devstack@n-api.service[61070]: Connection: close Apr 18 17:59:14 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 17:59:14 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 17:59:14 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 17:59:14 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 17:59:14 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtkfjY2Q1lqbzkQnL9-Dy5qNR1LqDyqI1THrGDH31aWEOwRLv3tsZ82QAT_ZHWB4wf85CqKA8ENmA4toxP-E3ilQBaA3mYEX89Cx6k0lDCSLL2zgRZprgYGmu12CFoSqnW40SKg35bCXIU0gfUVvbM96FtowrEODEnru9JPYPqcwZzE Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Project-Id: 84c8ef9ed106494081b51a6bccc144a6 Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Project-Name: tempest-VolumesAdminNegativeTest-815900507 Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84c8ef9ed106494081b51a6bccc144a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/84c8ef9ed106494081b51a6bccc144a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/84c8ef9ed106494081b51a6bccc144a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Tenant: tempest-VolumesAdminNegativeTest-815900507 Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Tenant-Id: 84c8ef9ed106494081b51a6bccc144a6 Apr 18 17:59:14 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-815900507 Apr 18 17:59:14 user devstack@n-api.service[61070]: X-User: tempest-VolumesAdminNegativeTest-815900507-project-member Apr 18 17:59:14 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 17:59:14 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 17:59:14 user devstack@n-api.service[61070]: X-User-Id: 468cf6197f4a4d49b3a58255e999bf9e Apr 18 17:59:14 user devstack@n-api.service[61070]: X-User-Name: tempest-VolumesAdminNegativeTest-815900507-project-member Apr 18 17:59:14 user devstack@n-api.service[61070]: method: > Apr 18 17:59:14 user devstack@n-api.service[61070]: exception: Instance a6133da6-009d-478a-97d5-17f345a33969 could not be found. Apr 18 17:59:14 user devstack@n-api.service[61070]: action_args: {'id': 'a6133da6-009d-478a-97d5-17f345a33969'} Apr 18 17:59:14 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6133da6-009d-478a-97d5-17f345a33969 could not be found. Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6133da6-009d-478a-97d5-17f345a33969 could not be found. Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6133da6-009d-478a-97d5-17f345a33969 could not be found. Apr 18 17:59:14 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 17:59:14 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Returning 404 to user: Instance a6133da6-009d-478a-97d5-17f345a33969 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 17:59:14 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-7f40cb03-22bc-449c-b6eb-c18c90f18913 tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969" status: 404 len: 111 microversion: 2.1 time: 0.136150 Apr 18 17:59:14 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 94/291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:14 2023] GET /compute/v2.1/servers/a6133da6-009d-478a-97d5-17f345a33969 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 17:59:14 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f224cde8-bccd-450d-8314-536cda14661f tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] Calling method '.version_select at 0x7fb35b16f010>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:14 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-f224cde8-bccd-450d-8314-536cda14661f tempest-VolumesAdminNegativeTest-815900507 tempest-VolumesAdminNegativeTest-815900507-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811804517" status: 202 len: 0 microversion: 2.1 time: 0.024239 Apr 18 17:59:14 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 102/292] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 17:59:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1811804517 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:59:16 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-6dcadc73-ad3a-434d-b05f-5ddd8320831b tempest-TestVolumeBootPattern-834560167 tempest-TestVolumeBootPattern-834560167-project-member] Calling method '.version_select at 0x7fb35b0ae440>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:16 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-6dcadc73-ad3a-434d-b05f-5ddd8320831b tempest-TestVolumeBootPattern-834560167 tempest-TestVolumeBootPattern-834560167-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-875210495" status: 202 len: 0 microversion: 2.1 time: 0.027572 Apr 18 17:59:16 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 97/293] 10.0.0.210 () {62 vars in 1337 bytes} [Tue Apr 18 17:59:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-875210495 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 17:59:20 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-716764202", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "destination_type": "volume"}], "networks": [{"uuid": "92a3fc19-c274-44eb-bd9d-958fdef4a359"}]}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:20 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:20 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] validate_networks() for [('92a3fc19-c274-44eb-bd9d-958fdef4a359', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Getting quotas for user 171127a60a304629949304db406a8f5b and project 03373e65e776406e823e7cc2b277d205. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:59:21 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:59:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-9615ecb5-963f-4435-90ea-3fa970c09eff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.162252 Apr 18 17:59:21 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 95/294] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 17:59:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 17:59:21 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:21 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-43ec3011-cbc6-4e21-ba7b-f2ba81c45f69 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:21 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-43ec3011-cbc6-4e21-ba7b-f2ba81c45f69 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:21 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-43ec3011-cbc6-4e21-ba7b-f2ba81c45f69 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:21 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-43ec3011-cbc6-4e21-ba7b-f2ba81c45f69 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:21 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-43ec3011-cbc6-4e21-ba7b-f2ba81c45f69 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:21 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-43ec3011-cbc6-4e21-ba7b-f2ba81c45f69 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283" status: 200 len: 1394 microversion: 2.87 time: 0.321077 Apr 18 17:59:21 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 103/295] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 17:59:21 2023] GET /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283 => generated 1394 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 17:59:24 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:24 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-619990bc-02b4-4b7b-8c65-0805835374b3 req-8c53c1c0-87b2-4989-b883-8d0e79cb2329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b0fb54-1532-4c34-a0a2-b571c80f6283", "tag": "11ff74ab-9633-498f-bf70-65589f7734a6"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:24 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-619990bc-02b4-4b7b-8c65-0805835374b3 req-8c53c1c0-87b2-4989-b883-8d0e79cb2329 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:24 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-619990bc-02b4-4b7b-8c65-0805835374b3 req-8c53c1c0-87b2-4989-b883-8d0e79cb2329 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:24 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-619990bc-02b4-4b7b-8c65-0805835374b3 req-8c53c1c0-87b2-4989-b883-8d0e79cb2329 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:24 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-619990bc-02b4-4b7b-8c65-0805835374b3 req-8c53c1c0-87b2-4989-b883-8d0e79cb2329 service nova] Creating event network-changed:11ff74ab-9633-498f-bf70-65589f7734a6 for instance 99b0fb54-1532-4c34-a0a2-b571c80f6283 on user Apr 18 17:59:24 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-619990bc-02b4-4b7b-8c65-0805835374b3 req-8c53c1c0-87b2-4989-b883-8d0e79cb2329 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037161 Apr 18 17:59:24 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 98/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-270389414", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "networks": [{"uuid": "b5626892-4f68-45ee-b684-0283fd7bf7d5"}]}} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.network.neutron [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] validate_networks() for [('b5626892-4f68-45ee-b684-0283fd7bf7d5', None, None, None, None, None)] {{(pid=61070) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Flavor limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Image limits 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Flavor pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Image pref 0:0:0 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.virt.hardware [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61070) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Getting quotas for project df19b002da6742dbb8ed4009530e5f20. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.quota [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Getting quotas for user 08887d6401f540fa9cf01c378af3c398 and project df19b002da6742dbb8ed4009530e5f20. Resources: {'ram', 'cores', 'instances'} {{(pid=61070) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Going to run 1 instances... {{(pid=61070) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 17:59:28 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61070) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 17:59:28 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-4458b76f-e377-4c6f-8ef3-c135ebc57dfe tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.568111 Apr 18 17:59:28 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 96/297] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 17:59:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 17:59:28 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:28 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-02af3461-ee17-4f0d-96ee-c896b3d85e73 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:28 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-02af3461-ee17-4f0d-96ee-c896b3d85e73 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:29 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-02af3461-ee17-4f0d-96ee-c896b3d85e73 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:29 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-02af3461-ee17-4f0d-96ee-c896b3d85e73 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b" status: 200 len: 1210 microversion: 2.1 time: 0.179842 Apr 18 17:59:29 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 104/298] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:28 2023] GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b => generated 1210 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:59:29 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-51803227-5c24-47ff-a60e-5b970746da28 req-c191887c-7eba-442a-8eda-f9b7bd4d28c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b0fb54-1532-4c34-a0a2-b571c80f6283", "name": "network-vif-deleted", "tag": "11ff74ab-9633-498f-bf70-65589f7734a6"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-51803227-5c24-47ff-a60e-5b970746da28 req-c191887c-7eba-442a-8eda-f9b7bd4d28c2 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-51803227-5c24-47ff-a60e-5b970746da28 req-c191887c-7eba-442a-8eda-f9b7bd4d28c2 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:29 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-51803227-5c24-47ff-a60e-5b970746da28 req-c191887c-7eba-442a-8eda-f9b7bd4d28c2 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:29 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.compute.server_external_events [req-51803227-5c24-47ff-a60e-5b970746da28 req-c191887c-7eba-442a-8eda-f9b7bd4d28c2 service nova] Unable to find a host for instance 99b0fb54-1532-4c34-a0a2-b571c80f6283. Dropping event network-vif-deleted {{(pid=61069) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 17:59:29 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-51803227-5c24-47ff-a60e-5b970746da28 req-c191887c-7eba-442a-8eda-f9b7bd4d28c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024611 Apr 18 17:59:29 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 99/299] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 17:59:31 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-f13578e0-6e6a-4af6-be3b-b980cbf4b4fc req-68cbc603-f8da-4a8b-8500-dfdb4e60901c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b111bc4a-871a-4cd9-aea7-1e55ab88a55b", "tag": "4bc58f6b-975c-404e-9dd2-5532a628cbed"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-f13578e0-6e6a-4af6-be3b-b980cbf4b4fc req-68cbc603-f8da-4a8b-8500-dfdb4e60901c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-f13578e0-6e6a-4af6-be3b-b980cbf4b4fc req-68cbc603-f8da-4a8b-8500-dfdb4e60901c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:31 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-f13578e0-6e6a-4af6-be3b-b980cbf4b4fc req-68cbc603-f8da-4a8b-8500-dfdb4e60901c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:31 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-f13578e0-6e6a-4af6-be3b-b980cbf4b4fc req-68cbc603-f8da-4a8b-8500-dfdb4e60901c service nova] Creating event network-changed:4bc58f6b-975c-404e-9dd2-5532a628cbed for instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b on user Apr 18 17:59:31 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-f13578e0-6e6a-4af6-be3b-b980cbf4b4fc req-68cbc603-f8da-4a8b-8500-dfdb4e60901c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044257 Apr 18 17:59:31 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 97/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:33 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-8efca6c9-c3a1-4523-9376-501bc881fecc req-21532a4b-c5b3-4c72-82e0-1c4512292d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b111bc4a-871a-4cd9-aea7-1e55ab88a55b", "name": "network-vif-plugged", "status": "completed", "tag": "4bc58f6b-975c-404e-9dd2-5532a628cbed"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-8efca6c9-c3a1-4523-9376-501bc881fecc req-21532a4b-c5b3-4c72-82e0-1c4512292d6a service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-8efca6c9-c3a1-4523-9376-501bc881fecc req-21532a4b-c5b3-4c72-82e0-1c4512292d6a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-8efca6c9-c3a1-4523-9376-501bc881fecc req-21532a4b-c5b3-4c72-82e0-1c4512292d6a service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-8efca6c9-c3a1-4523-9376-501bc881fecc req-21532a4b-c5b3-4c72-82e0-1c4512292d6a service nova] Creating event network-vif-plugged:4bc58f6b-975c-404e-9dd2-5532a628cbed for instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b on user Apr 18 17:59:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-8efca6c9-c3a1-4523-9376-501bc881fecc req-21532a4b-c5b3-4c72-82e0-1c4512292d6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028143 Apr 18 17:59:33 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 105/301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:35 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-022a48d8-f0cf-4b81-b848-f3a5a0d8bc06 req-f4b900a2-7602-4ad9-b29d-cb3a3271ded9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b111bc4a-871a-4cd9-aea7-1e55ab88a55b", "name": "network-vif-plugged", "status": "completed", "tag": "4bc58f6b-975c-404e-9dd2-5532a628cbed"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 17:59:35 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-022a48d8-f0cf-4b81-b848-f3a5a0d8bc06 req-f4b900a2-7602-4ad9-b29d-cb3a3271ded9 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-022a48d8-f0cf-4b81-b848-f3a5a0d8bc06 req-f4b900a2-7602-4ad9-b29d-cb3a3271ded9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-022a48d8-f0cf-4b81-b848-f3a5a0d8bc06 req-f4b900a2-7602-4ad9-b29d-cb3a3271ded9 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:35 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-022a48d8-f0cf-4b81-b848-f3a5a0d8bc06 req-f4b900a2-7602-4ad9-b29d-cb3a3271ded9 service nova] Creating event network-vif-plugged:4bc58f6b-975c-404e-9dd2-5532a628cbed for instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b on user Apr 18 17:59:35 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-022a48d8-f0cf-4b81-b848-f3a5a0d8bc06 req-f4b900a2-7602-4ad9-b29d-cb3a3271ded9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036471 Apr 18 17:59:35 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 100/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 17:59:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=22 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=10 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=14 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:43 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:43 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-aaa0c59a-0ed9-4b46-b39a-626ddfc8157e tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.246294 Apr 18 17:59:43 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 98/303] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:43 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=4 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=3 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:43 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:43 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-2b1f7e4a-1647-4ad4-909d-c399fb139d4b tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.330652 Apr 18 17:59:43 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 106/304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:43 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:44 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:44 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-d6d98082-2403-4085-b088-180e588b5526 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.258467 Apr 18 17:59:44 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:43 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 17:59:56 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c167bb97deb24907a1fb757b13e0a840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfd165764d6457ba971b760fc1f6718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 17:59:56 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-15454517-ddc6-4755-95ef-dd3c3f2c5c6b tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814" status: 200 len: 1536 microversion: 2.1 time: 0.385356 Apr 18 17:59:56 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 99/306] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 17:59:56 2023] GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 => generated 1536 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:00:03 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:03 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=8 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:04 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-987f5952-a26b-48f0-8ced-b8da6dcac02a tempest-TestStampPattern-1235317166 tempest-TestStampPattern-1235317166-project-member] Action: 'create', calling method: .version_select at 0x7fb35b16dea0>, body: {"keypair": {"name": "tempest-TestStampPattern-767316763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHXvxRJraw5TVfGQnzyfeUU0pZqAYtxo+I2y4RSgIkEIHjDQ7g4ZwT5+tNlyc4M7lrCh4zwPJPoz8x48qiyCSvX3WCuUBnekoOyCrth+Pt0Qh67xdzQJ68m3bGXxC3cLg=="}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:00:04 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-987f5952-a26b-48f0-8ced-b8da6dcac02a tempest-TestStampPattern-1235317166 tempest-TestStampPattern-1235317166-project-member] Getting quotas for project 01701c07fe4348398b3664d8cd8d01e6. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:00:04 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-987f5952-a26b-48f0-8ced-b8da6dcac02a tempest-TestStampPattern-1235317166 tempest-TestStampPattern-1235317166-project-member] Getting quotas for user 50ba755aa401416f82e937413cbd33a2 and project 01701c07fe4348398b3664d8cd8d01e6. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:00:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-987f5952-a26b-48f0-8ced-b8da6dcac02a tempest-TestStampPattern-1235317166 tempest-TestStampPattern-1235317166-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.323938 Apr 18 18:00:04 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 107/307] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 18:00:03 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:00:07 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-b8376c55-11f3-46c3-b587-3b430d9323ba tempest-TestStampPattern-1235317166 tempest-TestStampPattern-1235317166-project-member] Calling method '.version_select at 0x7fb35b0ac0d0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:07 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=3 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:07 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=12 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:07 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-b8376c55-11f3-46c3-b587-3b430d9323ba tempest-TestStampPattern-1235317166 tempest-TestStampPattern-1235317166-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-767316763" status: 202 len: 0 microversion: 2.1 time: 0.032173 Apr 18 18:00:07 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 102/308] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 18:00:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-767316763 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:11 user devstack@n-api.service[61070]: DEBUG nova.objects.instance [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lazy-loading 'fault' on Instance uuid 99b0fb54-1532-4c34-a0a2-b571c80f6283 {{(pid=61070) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 18:00:12 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:12 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:12 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:12 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-1105581f-f6c1-4700-9d07-2a26cb128efd tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283" status: 200 len: 1649 microversion: 2.87 time: 0.450960 Apr 18 18:00:12 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 100/309] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:00:11 2023] GET /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283 => generated 1649 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Doing local delete in cell 9d27f925-8bed-44bf-a25d-45ceb80a7926(cell1) {{(pid=61068) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:12 user devstack@n-api.service[61068]: WARNING nova.compute.api [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] instance's host None is down, deleting from database Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] deallocate_for_instance() {{(pid=61068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Instance cache missing network info. {{(pid=61068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Updating instance_info_cache with network_info: [] {{(pid=61068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 18:00:12 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61068) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 18:00:12 user devstack@n-api.service[61068]: WARNING nova.compute.api [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 18:00:12 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-be10a849-9ea0-4cf6-a053-88f4c347c380 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283" status: 204 len: 0 microversion: 2.87 time: 0.533275 Apr 18 18:00:12 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 108/310] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 18:00:12 2023] DELETE /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 99b0fb54-1532-4c34-a0a2-b571c80f6283] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:12 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] HTTP exception thrown: Instance 99b0fb54-1532-4c34-a0a2-b571c80f6283 could not be found. Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Request method failure captured: Apr 18 18:00:12 user devstack@n-api.service[61069]: request: GET /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283 HTTP/1.1 Apr 18 18:00:12 user devstack@n-api.service[61069]: Accept: application/json Apr 18 18:00:12 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 18:00:12 user devstack@n-api.service[61069]: Connection: close Apr 18 18:00:12 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 18:00:12 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 18:00:12 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 18:00:12 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 18:00:12 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtjeVJnpaNHYnMzFonBBnErtLbF5emN6SBqB2IfGIp5OgYGulgAS0-uonuBGrn5LKzCt9BayLxQyVRmqxZA2VtQEftu8EtTP1iOdybAn7wIylN6N9iC3Iu6iQ7H4-2YYYaS9JgZ0lk4cwATmnxiyBLMj4xR1ZiboL_FFnl9jlAs_NNc Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Project-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03373e65e776406e823e7cc2b277d205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Tenant-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 18:00:12 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:00:12 user devstack@n-api.service[61069]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 18:00:12 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 18:00:12 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 18:00:12 user devstack@n-api.service[61069]: X-User-Id: 171127a60a304629949304db406a8f5b Apr 18 18:00:12 user devstack@n-api.service[61069]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 18:00:12 user devstack@n-api.service[61069]: method: > Apr 18 18:00:12 user devstack@n-api.service[61069]: exception: Instance 99b0fb54-1532-4c34-a0a2-b571c80f6283 could not be found. Apr 18 18:00:12 user devstack@n-api.service[61069]: action_args: {'id': '99b0fb54-1532-4c34-a0a2-b571c80f6283'} Apr 18 18:00:12 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b0fb54-1532-4c34-a0a2-b571c80f6283 could not be found. Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b0fb54-1532-4c34-a0a2-b571c80f6283 could not be found. Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b0fb54-1532-4c34-a0a2-b571c80f6283 could not be found. Apr 18 18:00:12 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:00:12 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Returning 404 to user: Instance 99b0fb54-1532-4c34-a0a2-b571c80f6283 could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:00:12 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-576e407a-54ac-4461-be07-987eb2c406d1 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283" status: 404 len: 111 microversion: 2.87 time: 0.032358 Apr 18 18:00:12 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 103/311] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:00:12 2023] GET /compute/v2.1/servers/99b0fb54-1532-4c34-a0a2-b571c80f6283 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:13 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Going to try to terminate instance {{(pid=61070) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:00:13 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-6d656416-320b-4d38-ad63-d498b5662b10 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5" status: 204 len: 0 microversion: 2.87 time: 0.126312 Apr 18 18:00:13 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 101/312] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 18:00:13 2023] DELETE /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:13 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-c6bc9608-e6e3-4c5f-9d8e-9cf32d27a639 req-6e0022ef-742c-4da2-a678-f6befda5f7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5", "name": "network-vif-unplugged", "status": "completed", "tag": "f408febd-2774-4fec-877e-15e5b6e01e20"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:00:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-c6bc9608-e6e3-4c5f-9d8e-9cf32d27a639 req-6e0022ef-742c-4da2-a678-f6befda5f7ee service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-c6bc9608-e6e3-4c5f-9d8e-9cf32d27a639 req-6e0022ef-742c-4da2-a678-f6befda5f7ee service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:13 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-c6bc9608-e6e3-4c5f-9d8e-9cf32d27a639 req-6e0022ef-742c-4da2-a678-f6befda5f7ee service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-c6bc9608-e6e3-4c5f-9d8e-9cf32d27a639 req-6e0022ef-742c-4da2-a678-f6befda5f7ee service nova] Creating event network-vif-unplugged:f408febd-2774-4fec-877e-15e5b6e01e20 for instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 on user Apr 18 18:00:13 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-c6bc9608-e6e3-4c5f-9d8e-9cf32d27a639 req-6e0022ef-742c-4da2-a678-f6befda5f7ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028274 Apr 18 18:00:13 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 104/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:00:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:00:13 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-4c7fcaeb-9e82-4ba0-a013-77dd30ddb67e tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5" status: 200 len: 1697 microversion: 2.87 time: 0.279092 Apr 18 18:00:13 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 109/314] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:00:13 2023] GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 => generated 1697 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:00:14 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-8d65d06f-dc9a-4643-a2a4-64e9a1871e8c req-2233ddef-01b9-4fc3-9ea6-caabc451a6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5", "name": "network-vif-deleted", "tag": "f408febd-2774-4fec-877e-15e5b6e01e20"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:00:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-8d65d06f-dc9a-4643-a2a4-64e9a1871e8c req-2233ddef-01b9-4fc3-9ea6-caabc451a6af service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-8d65d06f-dc9a-4643-a2a4-64e9a1871e8c req-2233ddef-01b9-4fc3-9ea6-caabc451a6af service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-8d65d06f-dc9a-4643-a2a4-64e9a1871e8c req-2233ddef-01b9-4fc3-9ea6-caabc451a6af service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:15 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-8d65d06f-dc9a-4643-a2a4-64e9a1871e8c req-2233ddef-01b9-4fc3-9ea6-caabc451a6af service nova] Creating event network-vif-deleted:f408febd-2774-4fec-877e-15e5b6e01e20 for instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 on user Apr 18 18:00:15 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-8d65d06f-dc9a-4643-a2a4-64e9a1871e8c req-2233ddef-01b9-4fc3-9ea6-caabc451a6af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036728 Apr 18 18:00:15 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 102/315] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:00:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:00:15 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-a3b72ccf-0f84-4f09-b941-882b3c309996 req-d38b6be9-28d2-42dd-9158-3f1c43e96dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5", "name": "network-vif-plugged", "status": "completed", "tag": "f408febd-2774-4fec-877e-15e5b6e01e20"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:00:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a3b72ccf-0f84-4f09-b941-882b3c309996 req-d38b6be9-28d2-42dd-9158-3f1c43e96dbf service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a3b72ccf-0f84-4f09-b941-882b3c309996 req-d38b6be9-28d2-42dd-9158-3f1c43e96dbf service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-a3b72ccf-0f84-4f09-b941-882b3c309996 req-d38b6be9-28d2-42dd-9158-3f1c43e96dbf service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:15 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-a3b72ccf-0f84-4f09-b941-882b3c309996 req-d38b6be9-28d2-42dd-9158-3f1c43e96dbf service nova] Creating event network-vif-plugged:f408febd-2774-4fec-877e-15e5b6e01e20 for instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 on user Apr 18 18:00:15 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-a3b72ccf-0f84-4f09-b941-882b3c309996 req-d38b6be9-28d2-42dd-9158-3f1c43e96dbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029555 Apr 18 18:00:15 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 105/316] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=4 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:19 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:19 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-9e3b3dea-65e4-4b75-b379-f09e872e3655 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b" status: 200 len: 1493 microversion: 2.1 time: 0.233171 Apr 18 18:00:19 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 110/317] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:00:19 2023] GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b => generated 1493 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:46 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:00:46 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-be44a1e5-6482-4e84-8db8-a799778d6f91 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1658 microversion: 2.1 time: 0.248902 Apr 18 18:00:46 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 103/318] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:00:45 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1658 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:56 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:57 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-33016507-8a5a-4dae-afa7-06e1baebec40 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.570765 Apr 18 18:00:57 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 106/319] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 18:00:56 2023] GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814/os-interface => generated 283 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:00:57 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-ba59fa78-81af-41ac-805d-22f16e713ba2 req-d94c94d9-aa61-4614-bcc1-f8a02f7782ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d85bcc-3afe-4457-8975-18ff2395b814", "tag": "5ce5f67e-29f3-4ec1-a9f8-734b47f192e8"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:00:57 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:57 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:57 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-ba59fa78-81af-41ac-805d-22f16e713ba2 req-d94c94d9-aa61-4614-bcc1-f8a02f7782ea service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:57 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-ba59fa78-81af-41ac-805d-22f16e713ba2 req-d94c94d9-aa61-4614-bcc1-f8a02f7782ea service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:57 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-ba59fa78-81af-41ac-805d-22f16e713ba2 req-d94c94d9-aa61-4614-bcc1-f8a02f7782ea service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:58 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-ba59fa78-81af-41ac-805d-22f16e713ba2 req-d94c94d9-aa61-4614-bcc1-f8a02f7782ea service nova] Creating event network-changed:5ce5f67e-29f3-4ec1-a9f8-734b47f192e8 for instance 39d85bcc-3afe-4457-8975-18ff2395b814 on user Apr 18 18:00:58 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-ba59fa78-81af-41ac-805d-22f16e713ba2 req-d94c94d9-aa61-4614-bcc1-f8a02f7782ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042186 Apr 18 18:00:58 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 111/320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:58 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:58 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-75e8fa09-9ab5-4d6e-aefe-3c0e0649cb86 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814/ips" status: 200 len: 104 microversion: 2.1 time: 0.045902 Apr 18 18:00:58 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 104/321] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 18:00:58 2023] GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814/ips => generated 104 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:59 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:00:59 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-2ea1b591-c6cd-4e6e-9ce8-c873ababfd39 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814" status: 204 len: 0 microversion: 2.1 time: 0.117802 Apr 18 18:00:59 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 107/322] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:00:59 2023] DELETE /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:00:59 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-983e9422-7aaf-4b68-80a8-81f79080d845 req-f5ca7a00-630c-4263-b85d-94a357ad0526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d85bcc-3afe-4457-8975-18ff2395b814", "name": "network-vif-unplugged", "status": "completed", "tag": "5ce5f67e-29f3-4ec1-a9f8-734b47f192e8"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:00:59 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-983e9422-7aaf-4b68-80a8-81f79080d845 req-f5ca7a00-630c-4263-b85d-94a357ad0526 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:00:59 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-983e9422-7aaf-4b68-80a8-81f79080d845 req-f5ca7a00-630c-4263-b85d-94a357ad0526 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:00:59 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-983e9422-7aaf-4b68-80a8-81f79080d845 req-f5ca7a00-630c-4263-b85d-94a357ad0526 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:00 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-983e9422-7aaf-4b68-80a8-81f79080d845 req-f5ca7a00-630c-4263-b85d-94a357ad0526 service nova] Creating event network-vif-unplugged:5ce5f67e-29f3-4ec1-a9f8-734b47f192e8 for instance 39d85bcc-3afe-4457-8975-18ff2395b814 on user Apr 18 18:01:00 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-983e9422-7aaf-4b68-80a8-81f79080d845 req-f5ca7a00-630c-4263-b85d-94a357ad0526 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039889 Apr 18 18:01:00 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 105/323] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:00:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:00 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c167bb97deb24907a1fb757b13e0a840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbfd165764d6457ba971b760fc1f6718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:01:00 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-be19f244-b6c5-496e-a0e8-8fadf1fb00ff tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814" status: 200 len: 1661 microversion: 2.1 time: 0.473696 Apr 18 18:01:00 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 112/324] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:00:59 2023] GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 => generated 1661 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 18:01:01 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-64b257b3-d966-4ec0-a828-40ba0b05b43e req-f5479300-e8f2-4ef7-8097-0760d270815b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d85bcc-3afe-4457-8975-18ff2395b814", "name": "network-vif-deleted", "tag": "5ce5f67e-29f3-4ec1-a9f8-734b47f192e8"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-64b257b3-d966-4ec0-a828-40ba0b05b43e req-f5479300-e8f2-4ef7-8097-0760d270815b service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-64b257b3-d966-4ec0-a828-40ba0b05b43e req-f5479300-e8f2-4ef7-8097-0760d270815b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-64b257b3-d966-4ec0-a828-40ba0b05b43e req-f5479300-e8f2-4ef7-8097-0760d270815b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:01 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-64b257b3-d966-4ec0-a828-40ba0b05b43e req-f5479300-e8f2-4ef7-8097-0760d270815b service nova] Creating event network-vif-deleted:5ce5f67e-29f3-4ec1-a9f8-734b47f192e8 for instance 39d85bcc-3afe-4457-8975-18ff2395b814 on user Apr 18 18:01:01 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-64b257b3-d966-4ec0-a828-40ba0b05b43e req-f5479300-e8f2-4ef7-8097-0760d270815b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028608 Apr 18 18:01:01 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 108/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:02 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-ec9867a5-425f-4437-a6fa-7199c2db7958 req-3531c4aa-bb42-483a-9c4d-e4dc3315a8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d85bcc-3afe-4457-8975-18ff2395b814", "name": "network-vif-plugged", "status": "completed", "tag": "5ce5f67e-29f3-4ec1-a9f8-734b47f192e8"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:02 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ec9867a5-425f-4437-a6fa-7199c2db7958 req-3531c4aa-bb42-483a-9c4d-e4dc3315a8da service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:02 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ec9867a5-425f-4437-a6fa-7199c2db7958 req-3531c4aa-bb42-483a-9c4d-e4dc3315a8da service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:02 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ec9867a5-425f-4437-a6fa-7199c2db7958 req-3531c4aa-bb42-483a-9c4d-e4dc3315a8da service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:02 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-ec9867a5-425f-4437-a6fa-7199c2db7958 req-3531c4aa-bb42-483a-9c4d-e4dc3315a8da service nova] Creating event network-vif-plugged:5ce5f67e-29f3-4ec1-a9f8-734b47f192e8 for instance 39d85bcc-3afe-4457-8975-18ff2395b814 on user Apr 18 18:01:02 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-ec9867a5-425f-4437-a6fa-7199c2db7958 req-3531c4aa-bb42-483a-9c4d-e4dc3315a8da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031997 Apr 18 18:01:02 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 106/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:03 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] HTTP exception thrown: Instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 could not be found. Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Request method failure captured: Apr 18 18:01:03 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 HTTP/1.1 Apr 18 18:01:03 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:01:03 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:01:03 user devstack@n-api.service[61068]: Connection: close Apr 18 18:01:03 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:01:03 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:01:03 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:01:03 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:01:03 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjeVJnpaNHYnMzFonBBnErtLbF5emN6SBqB2IfGIp5OgYGulgAS0-uonuBGrn5LKzCt9BayLxQyVRmqxZA2VtQEftu8EtTP1iOdybAn7wIylN6N9iC3Iu6iQ7H4-2YYYaS9JgZ0lk4cwATmnxiyBLMj4xR1ZiboL_FFnl9jlAs_NNc Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Project-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03373e65e776406e823e7cc2b277d205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Tenant-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 18:01:03 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:01:03 user devstack@n-api.service[61068]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 18:01:03 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:01:03 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:01:03 user devstack@n-api.service[61068]: X-User-Id: 171127a60a304629949304db406a8f5b Apr 18 18:01:03 user devstack@n-api.service[61068]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 18:01:03 user devstack@n-api.service[61068]: method: > Apr 18 18:01:03 user devstack@n-api.service[61068]: exception: Instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 could not be found. Apr 18 18:01:03 user devstack@n-api.service[61068]: action_args: {'id': 'e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5'} Apr 18 18:01:03 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 could not be found. Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 could not be found. Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 could not be found. Apr 18 18:01:03 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:03 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Returning 404 to user: Instance e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:01:03 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-3ce1c070-3bbe-4e4d-b397-0c27c87ccf7c tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5" status: 404 len: 111 microversion: 2.87 time: 0.028827 Apr 18 18:01:03 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 113/327] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:01:03 2023] GET /compute/v2.1/servers/e3dfe4b7-6a7f-4e7f-9988-ad1c046460a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:03 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:01:03 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-0fea59c2-82af-46ef-b5cd-5e37f6e213ff tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929" status: 204 len: 0 microversion: 2.87 time: 0.108146 Apr 18 18:01:03 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 109/328] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 18:01:03 2023] DELETE /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:04 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:01:04 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:01:04 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '171127a60a304629949304db406a8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03373e65e776406e823e7cc2b277d205', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:01:04 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-0a3ac9fc-208e-41bb-a15e-7399d0a8a2bc tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929" status: 200 len: 1697 microversion: 2.87 time: 0.409553 Apr 18 18:01:04 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 107/329] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:01:03 2023] GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929 => generated 1697 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:01:04 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-bf8ca5a8-359f-4259-8be5-0a0b7de0aca4 req-2e556bdd-448b-480f-8d93-aa2722a6f916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d63901e-b9bf-4c51-b663-5399b7371929", "name": "network-vif-unplugged", "status": "completed", "tag": "c229b851-1edf-4ce4-bfa6-ec1370661073"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bf8ca5a8-359f-4259-8be5-0a0b7de0aca4 req-2e556bdd-448b-480f-8d93-aa2722a6f916 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bf8ca5a8-359f-4259-8be5-0a0b7de0aca4 req-2e556bdd-448b-480f-8d93-aa2722a6f916 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bf8ca5a8-359f-4259-8be5-0a0b7de0aca4 req-2e556bdd-448b-480f-8d93-aa2722a6f916 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-bf8ca5a8-359f-4259-8be5-0a0b7de0aca4 req-2e556bdd-448b-480f-8d93-aa2722a6f916 service nova] Creating event network-vif-unplugged:c229b851-1edf-4ce4-bfa6-ec1370661073 for instance 3d63901e-b9bf-4c51-b663-5399b7371929 on user Apr 18 18:01:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-bf8ca5a8-359f-4259-8be5-0a0b7de0aca4 req-2e556bdd-448b-480f-8d93-aa2722a6f916 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030159 Apr 18 18:01:04 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 114/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:05 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-e9202a6c-3f56-4f48-9991-ab7ddaf09677 req-d3285b57-14e9-4549-a870-fb07f01ce8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d63901e-b9bf-4c51-b663-5399b7371929", "name": "network-vif-deleted", "tag": "c229b851-1edf-4ce4-bfa6-ec1370661073"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:05 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e9202a6c-3f56-4f48-9991-ab7ddaf09677 req-d3285b57-14e9-4549-a870-fb07f01ce8f3 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:05 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e9202a6c-3f56-4f48-9991-ab7ddaf09677 req-d3285b57-14e9-4549-a870-fb07f01ce8f3 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:05 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-e9202a6c-3f56-4f48-9991-ab7ddaf09677 req-d3285b57-14e9-4549-a870-fb07f01ce8f3 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:05 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-e9202a6c-3f56-4f48-9991-ab7ddaf09677 req-d3285b57-14e9-4549-a870-fb07f01ce8f3 service nova] Creating event network-vif-deleted:c229b851-1edf-4ce4-bfa6-ec1370661073 for instance 3d63901e-b9bf-4c51-b663-5399b7371929 on user Apr 18 18:01:05 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-e9202a6c-3f56-4f48-9991-ab7ddaf09677 req-d3285b57-14e9-4549-a870-fb07f01ce8f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029485 Apr 18 18:01:05 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 110/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:06 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-0f99c27d-4b35-4525-82e2-2fc34119b23a req-76b7e047-94b7-42e1-9826-21d36b6c5bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d63901e-b9bf-4c51-b663-5399b7371929", "name": "network-vif-plugged", "status": "completed", "tag": "c229b851-1edf-4ce4-bfa6-ec1370661073"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:06 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0f99c27d-4b35-4525-82e2-2fc34119b23a req-76b7e047-94b7-42e1-9826-21d36b6c5bd7 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:06 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0f99c27d-4b35-4525-82e2-2fc34119b23a req-76b7e047-94b7-42e1-9826-21d36b6c5bd7 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:06 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-0f99c27d-4b35-4525-82e2-2fc34119b23a req-76b7e047-94b7-42e1-9826-21d36b6c5bd7 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:06 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-0f99c27d-4b35-4525-82e2-2fc34119b23a req-76b7e047-94b7-42e1-9826-21d36b6c5bd7 service nova] Creating event network-vif-plugged:c229b851-1edf-4ce4-bfa6-ec1370661073 for instance 3d63901e-b9bf-4c51-b663-5399b7371929 on user Apr 18 18:01:06 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-0f99c27d-4b35-4525-82e2-2fc34119b23a req-76b7e047-94b7-42e1-9826-21d36b6c5bd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028958 Apr 18 18:01:06 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 108/332] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=8 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=12 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:19 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:01:19 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-1992dd5a-c66b-4814-a59a-b394af5ec4a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b" status: 204 len: 0 microversion: 2.1 time: 0.115941 Apr 18 18:01:19 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 115/333] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:01:19 2023] DELETE /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:19 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=12 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:19 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=16 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:19 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-5a4bb32d-d7da-4305-b440-941eef2f895c req-a01996e9-a228-430c-89f0-22e113bd09b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b111bc4a-871a-4cd9-aea7-1e55ab88a55b", "name": "network-vif-unplugged", "status": "completed", "tag": "4bc58f6b-975c-404e-9dd2-5532a628cbed"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:19 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5a4bb32d-d7da-4305-b440-941eef2f895c req-a01996e9-a228-430c-89f0-22e113bd09b2 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:19 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5a4bb32d-d7da-4305-b440-941eef2f895c req-a01996e9-a228-430c-89f0-22e113bd09b2 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:19 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5a4bb32d-d7da-4305-b440-941eef2f895c req-a01996e9-a228-430c-89f0-22e113bd09b2 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:19 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-5a4bb32d-d7da-4305-b440-941eef2f895c req-a01996e9-a228-430c-89f0-22e113bd09b2 service nova] Creating event network-vif-unplugged:4bc58f6b-975c-404e-9dd2-5532a628cbed for instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b on user Apr 18 18:01:19 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-5a4bb32d-d7da-4305-b440-941eef2f895c req-a01996e9-a228-430c-89f0-22e113bd09b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036133 Apr 18 18:01:19 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 109/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:19 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:01:19 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-71635a59-fe01-4e92-b6ff-c000d9dbf712 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b" status: 200 len: 1499 microversion: 2.1 time: 0.247208 Apr 18 18:01:19 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:01:19 2023] GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b => generated 1499 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:01:20 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-7bb4ab88-40e8-4a7e-975d-0e242ba281d9 req-ce579617-8df6-4733-a94a-7ecc223b8686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b111bc4a-871a-4cd9-aea7-1e55ab88a55b", "name": "network-vif-deleted", "tag": "4bc58f6b-975c-404e-9dd2-5532a628cbed"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:20 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-7bb4ab88-40e8-4a7e-975d-0e242ba281d9 req-ce579617-8df6-4733-a94a-7ecc223b8686 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:20 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-7bb4ab88-40e8-4a7e-975d-0e242ba281d9 req-ce579617-8df6-4733-a94a-7ecc223b8686 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:20 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-7bb4ab88-40e8-4a7e-975d-0e242ba281d9 req-ce579617-8df6-4733-a94a-7ecc223b8686 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:20 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-7bb4ab88-40e8-4a7e-975d-0e242ba281d9 req-ce579617-8df6-4733-a94a-7ecc223b8686 service nova] Creating event network-vif-deleted:4bc58f6b-975c-404e-9dd2-5532a628cbed for instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b on user Apr 18 18:01:20 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-7bb4ab88-40e8-4a7e-975d-0e242ba281d9 req-ce579617-8df6-4733-a94a-7ecc223b8686 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028407 Apr 18 18:01:20 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 116/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:21 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-75af6fd2-0edf-493e-9ea8-ac28c257b5f7 req-86538bb6-4e84-4343-bb77-236ff3d5c9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b111bc4a-871a-4cd9-aea7-1e55ab88a55b", "name": "network-vif-plugged", "status": "completed", "tag": "4bc58f6b-975c-404e-9dd2-5532a628cbed"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-75af6fd2-0edf-493e-9ea8-ac28c257b5f7 req-86538bb6-4e84-4343-bb77-236ff3d5c9e4 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-75af6fd2-0edf-493e-9ea8-ac28c257b5f7 req-86538bb6-4e84-4343-bb77-236ff3d5c9e4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:21 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-75af6fd2-0edf-493e-9ea8-ac28c257b5f7 req-86538bb6-4e84-4343-bb77-236ff3d5c9e4 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-75af6fd2-0edf-493e-9ea8-ac28c257b5f7 req-86538bb6-4e84-4343-bb77-236ff3d5c9e4 service nova] Creating event network-vif-plugged:4bc58f6b-975c-404e-9dd2-5532a628cbed for instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b on user Apr 18 18:01:21 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-75af6fd2-0edf-493e-9ea8-ac28c257b5f7 req-86538bb6-4e84-4343-bb77-236ff3d5c9e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Apr 18 18:01:21 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 110/337] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:46 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:01:46 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-a4a2b472-58c9-4aad-b146-2429cd8ee919 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 204 len: 0 microversion: 2.1 time: 0.122585 Apr 18 18:01:46 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:01:46 2023] DELETE /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:47 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:47 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:01:47 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-3d90e51c-77bb-4671-be64-6cfc63502af2 req-0436e5e4-00d3-4ca6-95ea-791aba73be3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ff41f2-dacf-49c7-8c2e-7621fbca6af2", "name": "network-vif-unplugged", "status": "completed", "tag": "b76c25db-01e7-4cf3-9457-3c7e8ec1db2a"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:47 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5530d6dd1b104cd7824717aea8f429cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd89586cda04a249c938937bff52645', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:01:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-3d90e51c-77bb-4671-be64-6cfc63502af2 req-0436e5e4-00d3-4ca6-95ea-791aba73be3f service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:47 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-93fc6130-4638-494f-b836-f639513c7b97 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 200 len: 1664 microversion: 2.1 time: 0.364413 Apr 18 18:01:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-3d90e51c-77bb-4671-be64-6cfc63502af2 req-0436e5e4-00d3-4ca6-95ea-791aba73be3f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-3d90e51c-77bb-4671-be64-6cfc63502af2 req-0436e5e4-00d3-4ca6-95ea-791aba73be3f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:47 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 117/339] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:01:46 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 1664 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:01:47 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-3d90e51c-77bb-4671-be64-6cfc63502af2 req-0436e5e4-00d3-4ca6-95ea-791aba73be3f service nova] Creating event network-vif-unplugged:b76c25db-01e7-4cf3-9457-3c7e8ec1db2a for instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 on user Apr 18 18:01:47 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-3d90e51c-77bb-4671-be64-6cfc63502af2 req-0436e5e4-00d3-4ca6-95ea-791aba73be3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041805 Apr 18 18:01:47 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 111/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:48 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-dee49ded-f552-4960-83d9-826310456316 req-909be3fb-945c-43b5-8cef-9c158353ddba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ff41f2-dacf-49c7-8c2e-7621fbca6af2", "name": "network-vif-deleted", "tag": "b76c25db-01e7-4cf3-9457-3c7e8ec1db2a"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:48 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-dee49ded-f552-4960-83d9-826310456316 req-909be3fb-945c-43b5-8cef-9c158353ddba service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:48 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-dee49ded-f552-4960-83d9-826310456316 req-909be3fb-945c-43b5-8cef-9c158353ddba service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:48 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-dee49ded-f552-4960-83d9-826310456316 req-909be3fb-945c-43b5-8cef-9c158353ddba service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:48 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-dee49ded-f552-4960-83d9-826310456316 req-909be3fb-945c-43b5-8cef-9c158353ddba service nova] Creating event network-vif-deleted:b76c25db-01e7-4cf3-9457-3c7e8ec1db2a for instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 on user Apr 18 18:01:48 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-dee49ded-f552-4960-83d9-826310456316 req-909be3fb-945c-43b5-8cef-9c158353ddba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027005 Apr 18 18:01:48 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:49 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-3d109a25-bf70-4aed-b31d-7744988c62e5 req-672b7e94-9549-451a-a410-1dcc91a479f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ff41f2-dacf-49c7-8c2e-7621fbca6af2", "name": "network-vif-plugged", "status": "completed", "tag": "b76c25db-01e7-4cf3-9457-3c7e8ec1db2a"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:01:49 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-3d109a25-bf70-4aed-b31d-7744988c62e5 req-672b7e94-9549-451a-a410-1dcc91a479f1 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:49 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-3d109a25-bf70-4aed-b31d-7744988c62e5 req-672b7e94-9549-451a-a410-1dcc91a479f1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:49 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-3d109a25-bf70-4aed-b31d-7744988c62e5 req-672b7e94-9549-451a-a410-1dcc91a479f1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:49 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-3d109a25-bf70-4aed-b31d-7744988c62e5 req-672b7e94-9549-451a-a410-1dcc91a479f1 service nova] Creating event network-vif-plugged:b76c25db-01e7-4cf3-9457-3c7e8ec1db2a for instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 on user Apr 18 18:01:49 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-3d109a25-bf70-4aed-b31d-7744988c62e5 req-672b7e94-9549-451a-a410-1dcc91a479f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Apr 18 18:01:49 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 118/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:01:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:50 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] HTTP exception thrown: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Request method failure captured: Apr 18 18:01:50 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 HTTP/1.1 Apr 18 18:01:50 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:01:50 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:01:50 user devstack@n-api.service[61070]: Connection: close Apr 18 18:01:50 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:01:50 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:01:50 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:01:50 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:01:50 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtm-FFuk3p45mxd3v9ZjCV8cnHa0-u7-bbTrhXolV7dsSYiNB750hkk9B3jts6eA_mJaT9Iw2oei3qP_ZCy6atcCB4gllWjc6kepp_w4oOZ5Dh8LSulVVTg9DNksD69qtA7YsX6JwC_8nR2O2FPYa2jY3OPRqhFbFxodCH2XPiqvNYQ Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Project-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Tenant-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:50 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:50 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:50 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:01:50 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:01:50 user devstack@n-api.service[61070]: X-User-Id: c167bb97deb24907a1fb757b13e0a840 Apr 18 18:01:50 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:50 user devstack@n-api.service[61070]: method: > Apr 18 18:01:50 user devstack@n-api.service[61070]: exception: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:50 user devstack@n-api.service[61070]: action_args: {'id': '39d85bcc-3afe-4457-8975-18ff2395b814'} Apr 18 18:01:50 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:50 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:50 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Returning 404 to user: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:01:50 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-e6b4f83e-ad62-4a4d-82da-d76aca12add8 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814" status: 404 len: 111 microversion: 2.1 time: 0.251970 Apr 18 18:01:50 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 112/343] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:01:50 2023] GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:01:50 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-a755f126-cc83-4294-90ef-49e1f5d80da7 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '.version_select at 0x7fb35b0af7f0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-a755f126-cc83-4294-90ef-49e1f5d80da7 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475602808" status: 202 len: 0 microversion: 2.1 time: 0.024296 Apr 18 18:01:50 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 114/344] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 18:01:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1475602808 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] HTTP exception thrown: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Request method failure captured: Apr 18 18:01:51 user devstack@n-api.service[61068]: request: DELETE /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 HTTP/1.1 Apr 18 18:01:51 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:01:51 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:01:51 user devstack@n-api.service[61068]: Connection: close Apr 18 18:01:51 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:01:51 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:01:51 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:01:51 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:01:51 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtm-FFuk3p45mxd3v9ZjCV8cnHa0-u7-bbTrhXolV7dsSYiNB750hkk9B3jts6eA_mJaT9Iw2oei3qP_ZCy6atcCB4gllWjc6kepp_w4oOZ5Dh8LSulVVTg9DNksD69qtA7YsX6JwC_8nR2O2FPYa2jY3OPRqhFbFxodCH2XPiqvNYQ Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Tenant-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Id: c167bb97deb24907a1fb757b13e0a840 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61068]: method: > Apr 18 18:01:51 user devstack@n-api.service[61068]: exception: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: action_args: {'id': '39d85bcc-3afe-4457-8975-18ff2395b814'} Apr 18 18:01:51 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Returning 404 to user: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:01:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-48bcc5a4-3917-431f-9720-89b013a77106 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814" status: 404 len: 111 microversion: 2.1 time: 0.035954 Apr 18 18:01:51 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 119/345] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:01:51 2023] DELETE /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 39d85bcc-3afe-4457-8975-18ff2395b814] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] HTTP exception thrown: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Request method failure captured: Apr 18 18:01:51 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 HTTP/1.1 Apr 18 18:01:51 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:01:51 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:01:51 user devstack@n-api.service[61070]: Connection: close Apr 18 18:01:51 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:01:51 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:01:51 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:01:51 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:01:51 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtm-FFuk3p45mxd3v9ZjCV8cnHa0-u7-bbTrhXolV7dsSYiNB750hkk9B3jts6eA_mJaT9Iw2oei3qP_ZCy6atcCB4gllWjc6kepp_w4oOZ5Dh8LSulVVTg9DNksD69qtA7YsX6JwC_8nR2O2FPYa2jY3OPRqhFbFxodCH2XPiqvNYQ Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Project-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Tenant-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61070]: X-User-Id: c167bb97deb24907a1fb757b13e0a840 Apr 18 18:01:51 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61070]: method: > Apr 18 18:01:51 user devstack@n-api.service[61070]: exception: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61070]: action_args: {'id': '39d85bcc-3afe-4457-8975-18ff2395b814'} Apr 18 18:01:51 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Returning 404 to user: Instance 39d85bcc-3afe-4457-8975-18ff2395b814 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:01:51 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-89d249cc-8b3d-45cf-b802-f3b6e24ecb44 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814" status: 404 len: 111 microversion: 2.1 time: 0.030617 Apr 18 18:01:51 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 113/346] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:01:51 2023] GET /compute/v2.1/servers/39d85bcc-3afe-4457-8975-18ff2395b814 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] HTTP exception thrown: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Request method failure captured: Apr 18 18:01:51 user devstack@n-api.service[61069]: request: DELETE /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 HTTP/1.1 Apr 18 18:01:51 user devstack@n-api.service[61069]: Accept: application/json Apr 18 18:01:51 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 18:01:51 user devstack@n-api.service[61069]: Connection: close Apr 18 18:01:51 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 18:01:51 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 18:01:51 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 18:01:51 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 18:01:51 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtm-FFuk3p45mxd3v9ZjCV8cnHa0-u7-bbTrhXolV7dsSYiNB750hkk9B3jts6eA_mJaT9Iw2oei3qP_ZCy6atcCB4gllWjc6kepp_w4oOZ5Dh8LSulVVTg9DNksD69qtA7YsX6JwC_8nR2O2FPYa2jY3OPRqhFbFxodCH2XPiqvNYQ Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Project-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Project-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Tenant: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Tenant-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61069]: X-User: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61069]: X-User-Id: c167bb97deb24907a1fb757b13e0a840 Apr 18 18:01:51 user devstack@n-api.service[61069]: X-User-Name: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61069]: method: > Apr 18 18:01:51 user devstack@n-api.service[61069]: exception: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61069]: action_args: {'id': '8de60266-38a3-4baf-9b87-aaf7199edb62'} Apr 18 18:01:51 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Returning 404 to user: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:01:51 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-b6ee2877-681a-44cb-b006-50d771d2bd8f tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62" status: 404 len: 111 microversion: 2.1 time: 0.033026 Apr 18 18:01:51 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:01:51 2023] DELETE /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] [instance: 8de60266-38a3-4baf-9b87-aaf7199edb62] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] HTTP exception thrown: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Request method failure captured: Apr 18 18:01:51 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 HTTP/1.1 Apr 18 18:01:51 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:01:51 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:01:51 user devstack@n-api.service[61068]: Connection: close Apr 18 18:01:51 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:01:51 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:01:51 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:01:51 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:01:51 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtm-FFuk3p45mxd3v9ZjCV8cnHa0-u7-bbTrhXolV7dsSYiNB750hkk9B3jts6eA_mJaT9Iw2oei3qP_ZCy6atcCB4gllWjc6kepp_w4oOZ5Dh8LSulVVTg9DNksD69qtA7YsX6JwC_8nR2O2FPYa2jY3OPRqhFbFxodCH2XPiqvNYQ Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fbfd165764d6457ba971b760fc1f6718"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Tenant-Id: fbfd165764d6457ba971b760fc1f6718 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachVolumeTestJSON-709288454 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Id: c167bb97deb24907a1fb757b13e0a840 Apr 18 18:01:51 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachVolumeTestJSON-709288454-project-member Apr 18 18:01:51 user devstack@n-api.service[61068]: method: > Apr 18 18:01:51 user devstack@n-api.service[61068]: exception: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: action_args: {'id': '8de60266-38a3-4baf-9b87-aaf7199edb62'} Apr 18 18:01:51 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. Apr 18 18:01:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:01:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] Returning 404 to user: Instance 8de60266-38a3-4baf-9b87-aaf7199edb62 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:01:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-3c5abcf8-0e6d-4db1-9879-518f7f7ab519 tempest-AttachVolumeTestJSON-709288454 tempest-AttachVolumeTestJSON-709288454-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62" status: 404 len: 111 microversion: 2.1 time: 0.031446 Apr 18 18:01:51 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 120/348] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:01:51 2023] GET /compute/v2.1/servers/8de60266-38a3-4baf-9b87-aaf7199edb62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] [instance: 3d63901e-b9bf-4c51-b663-5399b7371929] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:01:54 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] HTTP exception thrown: Instance 3d63901e-b9bf-4c51-b663-5399b7371929 could not be found. Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Request method failure captured: Apr 18 18:01:54 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929 HTTP/1.1 Apr 18 18:01:54 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:01:54 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:01:54 user devstack@n-api.service[61070]: Connection: close Apr 18 18:01:54 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:01:54 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:01:54 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:01:54 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:01:54 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtjeVJnpaNHYnMzFonBBnErtLbF5emN6SBqB2IfGIp5OgYGulgAS0-uonuBGrn5LKzCt9BayLxQyVRmqxZA2VtQEftu8EtTP1iOdybAn7wIylN6N9iC3Iu6iQ7H4-2YYYaS9JgZ0lk4cwATmnxiyBLMj4xR1ZiboL_FFnl9jlAs_NNc Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Project-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03373e65e776406e823e7cc2b277d205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03373e65e776406e823e7cc2b277d205"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Tenant-Id: 03373e65e776406e823e7cc2b277d205 Apr 18 18:01:54 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792 Apr 18 18:01:54 user devstack@n-api.service[61070]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 18:01:54 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:01:54 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:01:54 user devstack@n-api.service[61070]: X-User-Id: 171127a60a304629949304db406a8f5b Apr 18 18:01:54 user devstack@n-api.service[61070]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member Apr 18 18:01:54 user devstack@n-api.service[61070]: method: > Apr 18 18:01:54 user devstack@n-api.service[61070]: exception: Instance 3d63901e-b9bf-4c51-b663-5399b7371929 could not be found. Apr 18 18:01:54 user devstack@n-api.service[61070]: action_args: {'id': '3d63901e-b9bf-4c51-b663-5399b7371929'} Apr 18 18:01:54 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d63901e-b9bf-4c51-b663-5399b7371929 could not be found. Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d63901e-b9bf-4c51-b663-5399b7371929 could not be found. Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d63901e-b9bf-4c51-b663-5399b7371929 could not be found. Apr 18 18:01:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:01:54 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] Returning 404 to user: Instance 3d63901e-b9bf-4c51-b663-5399b7371929 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:01:54 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-854eaeeb-04b7-41c4-afa2-5361a9aa14a2 tempest-ServerBootFromVolumeStableRescueTest-740353792 tempest-ServerBootFromVolumeStableRescueTest-740353792-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929" status: 404 len: 111 microversion: 2.87 time: 0.029138 Apr 18 18:01:54 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 114/349] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:01:54 2023] GET /compute/v2.1/servers/3d63901e-b9bf-4c51-b663-5399b7371929 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:02:04 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:04 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:04 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-3c549da5-90f5-4ce0-94ad-063b9866c41a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Action: 'create', calling method: .version_select at 0x7fb35b0af250>, body: {"keypair": {"name": "tempest-keypair-641272335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFINWKZWhQrT78jlL/+7982rIR4N5NrYmDmPFcU0JusOl8uVB9EAooRd4zd6TRTnbUEooggtFCUmps38wuHipTq2hUsRF62Tby4UY6PHDEgmzsaV7JGKesurzYQ3L3cjg=="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:04 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-3c549da5-90f5-4ce0-94ad-063b9866c41a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:02:04 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-3c549da5-90f5-4ce0-94ad-063b9866c41a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for user 3da8052dbf914e1cb2ee508d2bb21bd7 and project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:02:04 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-3c549da5-90f5-4ce0-94ad-063b9866c41a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.205516 Apr 18 18:02:04 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 116/350] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 18:02:04 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1353650477", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "56ee566b-b65a-4747-a0ad-917fef191e6f"}], "security_groups": [{"name": "tempest-securitygroup--915440862"}], "key_name": "tempest-keypair-641272335", "user_data": "}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=8 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=12 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] validate_networks() for [('56ee566b-b65a-4747-a0ad-917fef191e6f', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:06 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:02:07 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for user 3da8052dbf914e1cb2ee508d2bb21bd7 and project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:02:07 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 18:02:07 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 18:02:07 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-0c60c326-6e49-4a35-a72b-a93f23bc75c6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.998940 Apr 18 18:02:07 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 121/351] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 18:02:06 2023] POST /compute/v2.1/servers => generated 399 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 18:02:07 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-bf9f3858-17bf-4b7f-a8bf-d064b8087f8b tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:02:07 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-bf9f3858-17bf-4b7f-a8bf-d064b8087f8b tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:02:07 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=8 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:07 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=8 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:07 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-bf9f3858-17bf-4b7f-a8bf-d064b8087f8b tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:02:07 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-bf9f3858-17bf-4b7f-a8bf-d064b8087f8b tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c" status: 200 len: 1235 microversion: 2.1 time: 0.115860 Apr 18 18:02:07 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 115/352] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:02:07 2023] GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c => generated 1235 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:02:08 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-9950025e-150f-49c5-9b72-65d564a07343 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Action: 'create', calling method: .version_select at 0x7fb35b0ac8b0>, body: {"keypair": {"name": "tempest-keypair-395164576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+7kUX36a65xx5Bt/IxAslDZaRlsD5F1Y9dUWuTjvYAzqz3nqAr9NZgSirWlRCVS6NxkFrEcZZu3qAMIk4GW1KHx1MTftx54FRD5C3T5Dn0ahmuX1R1QaVVkmTGe7Ku1A=="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:08 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-9950025e-150f-49c5-9b72-65d564a07343 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for project bd90ac6164a645e1829a7c53dc58f906. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:02:08 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-9950025e-150f-49c5-9b72-65d564a07343 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for user 2169669cc67547a18bf80a0eb08b39b0 and project bd90ac6164a645e1829a7c53dc58f906. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:02:08 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-9950025e-150f-49c5-9b72-65d564a07343 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.090718 Apr 18 18:02:08 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 117/353] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 18:02:08 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:09 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] HTTP exception thrown: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Request method failure captured: Apr 18 18:02:09 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b HTTP/1.1 Apr 18 18:02:09 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:02:09 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:02:09 user devstack@n-api.service[61068]: Connection: close Apr 18 18:02:09 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:02:09 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:02:09 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:02:09 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:02:09 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtoQZARdrKyykcAhB6sEESGBOkof7KZzLK_37Nrys6D-Wmm0zXqjOpGsR9xPouT44TARNDutifcwnYGjxq0HtcU6kkSUr96ijcAV2c9QLCGfROp9P_n1HdHbuuAjkczMK4KN5M8N6clSUcTrZF4NXDD4Y9tolDGIxMQ4CnMSprxSaCY Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Project-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Project-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Tenant: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Tenant-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:02:09 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:02:09 user devstack@n-api.service[61068]: X-User: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:02:09 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:02:09 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:02:09 user devstack@n-api.service[61068]: X-User-Id: 08887d6401f540fa9cf01c378af3c398 Apr 18 18:02:09 user devstack@n-api.service[61068]: X-User-Name: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:02:09 user devstack@n-api.service[61068]: method: > Apr 18 18:02:09 user devstack@n-api.service[61068]: exception: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:02:09 user devstack@n-api.service[61068]: action_args: {'id': 'b111bc4a-871a-4cd9-aea7-1e55ab88a55b'} Apr 18 18:02:09 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:02:09 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:09 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Returning 404 to user: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:02:09 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-b6b47db9-bdb8-4909-9e8f-d4d14a77ebe0 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b" status: 404 len: 111 microversion: 2.1 time: 0.030509 Apr 18 18:02:09 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 122/354] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:02:09 2023] GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:09 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:09 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-35fdd80e-9b57-459e-977e-a18254adde02 req-b673086c-c57e-4e05-bd8a-1a1b01a5966c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03edc06-3774-4d88-82f8-f9f83e82230c", "tag": "5f0a4b88-d443-4e86-9b18-6f7dcfb74aea"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:09 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-35fdd80e-9b57-459e-977e-a18254adde02 req-b673086c-c57e-4e05-bd8a-1a1b01a5966c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:09 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-35fdd80e-9b57-459e-977e-a18254adde02 req-b673086c-c57e-4e05-bd8a-1a1b01a5966c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:09 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-35fdd80e-9b57-459e-977e-a18254adde02 req-b673086c-c57e-4e05-bd8a-1a1b01a5966c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:09 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-35fdd80e-9b57-459e-977e-a18254adde02 req-b673086c-c57e-4e05-bd8a-1a1b01a5966c service nova] Creating event network-changed:5f0a4b88-d443-4e86-9b18-6f7dcfb74aea for instance f03edc06-3774-4d88-82f8-f9f83e82230c on user Apr 18 18:02:09 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-35fdd80e-9b57-459e-977e-a18254adde02 req-b673086c-c57e-4e05-bd8a-1a1b01a5966c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030230 Apr 18 18:02:09 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 118/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:02:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:02:10 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:02:10 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-3de8090c-ec9e-4a83-ad63-15149079cfe2 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 200 len: 1491 microversion: 2.1 time: 0.725998 Apr 18 18:02:10 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 116/356] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:02:09 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 1491 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:02:10 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-702551232", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "26dbb1c5-e7b6-45d6-803a-31acef317435"}], "security_groups": [{"name": "tempest-securitygroup--2021537316"}], "key_name": "tempest-keypair-395164576", "user_data": "}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:10 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] validate_networks() for [('26dbb1c5-e7b6-45d6-803a-31acef317435', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for project bd90ac6164a645e1829a7c53dc58f906. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for user 2169669cc67547a18bf80a0eb08b39b0 and project bd90ac6164a645e1829a7c53dc58f906. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 18:02:11 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 18:02:11 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-f963d0f0-4e7b-494f-a52a-ef39395c0b2b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.686899 Apr 18 18:02:11 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 123/357] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 18:02:10 2023] POST /compute/v2.1/servers => generated 400 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 18:02:11 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-dd2d8c1a-6084-4cbf-8feb-b5a0a0883980 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:02:11 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-dd2d8c1a-6084-4cbf-8feb-b5a0a0883980 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:02:11 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-dd2d8c1a-6084-4cbf-8feb-b5a0a0883980 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:02:11 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-dd2d8c1a-6084-4cbf-8feb-b5a0a0883980 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:02:11 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-dd2d8c1a-6084-4cbf-8feb-b5a0a0883980 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:02:11 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-dd2d8c1a-6084-4cbf-8feb-b5a0a0883980 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087" status: 200 len: 1274 microversion: 2.20 time: 0.080175 Apr 18 18:02:11 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 119/358] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:02:11 2023] GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 => generated 1274 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:02:11 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-12a715a6-ed6b-4adc-a740-a48d391b52f3 req-0afbb112-cfbe-4180-ace7-21924ce8c54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03edc06-3774-4d88-82f8-f9f83e82230c", "name": "network-vif-plugged", "status": "completed", "tag": "5f0a4b88-d443-4e86-9b18-6f7dcfb74aea"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-12a715a6-ed6b-4adc-a740-a48d391b52f3 req-0afbb112-cfbe-4180-ace7-21924ce8c54d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-12a715a6-ed6b-4adc-a740-a48d391b52f3 req-0afbb112-cfbe-4180-ace7-21924ce8c54d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:11 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-12a715a6-ed6b-4adc-a740-a48d391b52f3 req-0afbb112-cfbe-4180-ace7-21924ce8c54d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:11 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-12a715a6-ed6b-4adc-a740-a48d391b52f3 req-0afbb112-cfbe-4180-ace7-21924ce8c54d service nova] Creating event network-vif-plugged:5f0a4b88-d443-4e86-9b18-6f7dcfb74aea for instance f03edc06-3774-4d88-82f8-f9f83e82230c on user Apr 18 18:02:11 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-12a715a6-ed6b-4adc-a740-a48d391b52f3 req-0afbb112-cfbe-4180-ace7-21924ce8c54d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034567 Apr 18 18:02:11 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 117/359] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:02:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:02:13 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-8c6bc68f-0382-41a8-b11b-88a7b5ff91d8 req-0bbfcc08-e636-4719-82c6-df3778921778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-8c6bc68f-0382-41a8-b11b-88a7b5ff91d8 req-0bbfcc08-e636-4719-82c6-df3778921778 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-8c6bc68f-0382-41a8-b11b-88a7b5ff91d8 req-0bbfcc08-e636-4719-82c6-df3778921778 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:13 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-8c6bc68f-0382-41a8-b11b-88a7b5ff91d8 req-0bbfcc08-e636-4719-82c6-df3778921778 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:13 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-8c6bc68f-0382-41a8-b11b-88a7b5ff91d8 req-0bbfcc08-e636-4719-82c6-df3778921778 service nova] Creating event network-changed:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:02:13 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-8c6bc68f-0382-41a8-b11b-88a7b5ff91d8 req-0bbfcc08-e636-4719-82c6-df3778921778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032040 Apr 18 18:02:13 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 124/360] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:02:13 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-9feeaa59-fc23-4e11-a68a-4fc5962cb43d req-134ea525-887c-4ff3-a2d2-810a93d57db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03edc06-3774-4d88-82f8-f9f83e82230c", "name": "network-vif-plugged", "status": "completed", "tag": "5f0a4b88-d443-4e86-9b18-6f7dcfb74aea"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:14 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-9feeaa59-fc23-4e11-a68a-4fc5962cb43d req-134ea525-887c-4ff3-a2d2-810a93d57db1 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:14 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-9feeaa59-fc23-4e11-a68a-4fc5962cb43d req-134ea525-887c-4ff3-a2d2-810a93d57db1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:14 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-9feeaa59-fc23-4e11-a68a-4fc5962cb43d req-134ea525-887c-4ff3-a2d2-810a93d57db1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:14 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-9feeaa59-fc23-4e11-a68a-4fc5962cb43d req-134ea525-887c-4ff3-a2d2-810a93d57db1 service nova] Creating event network-vif-plugged:5f0a4b88-d443-4e86-9b18-6f7dcfb74aea for instance f03edc06-3774-4d88-82f8-f9f83e82230c on user Apr 18 18:02:14 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-9feeaa59-fc23-4e11-a68a-4fc5962cb43d req-134ea525-887c-4ff3-a2d2-810a93d57db1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034543 Apr 18 18:02:14 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 120/361] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:02:16 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-ce8158f4-ec60-4b08-9507-18fb0aca61f8 req-e8edeb32-7c46-44d9-b587-9aef47b48f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-plugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}, {"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-plugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:02:16 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ce8158f4-ec60-4b08-9507-18fb0aca61f8 req-e8edeb32-7c46-44d9-b587-9aef47b48f36 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:16 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ce8158f4-ec60-4b08-9507-18fb0aca61f8 req-e8edeb32-7c46-44d9-b587-9aef47b48f36 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:16 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-ce8158f4-ec60-4b08-9507-18fb0aca61f8 req-e8edeb32-7c46-44d9-b587-9aef47b48f36 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:16 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-ce8158f4-ec60-4b08-9507-18fb0aca61f8 req-e8edeb32-7c46-44d9-b587-9aef47b48f36 service nova] Creating event network-vif-plugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:02:16 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-ce8158f4-ec60-4b08-9507-18fb0aca61f8 req-e8edeb32-7c46-44d9-b587-9aef47b48f36 service nova] Creating event network-vif-plugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:02:16 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-ce8158f4-ec60-4b08-9507-18fb0aca61f8 req-e8edeb32-7c46-44d9-b587-9aef47b48f36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033066 Apr 18 18:02:16 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 118/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:02:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=4 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=12 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=8 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] [instance: 46ff41f2-dacf-49c7-8c2e-7621fbca6af2] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:37 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] HTTP exception thrown: Instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 could not be found. Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Request method failure captured: Apr 18 18:02:37 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 HTTP/1.1 Apr 18 18:02:37 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:02:37 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:02:37 user devstack@n-api.service[61068]: Connection: close Apr 18 18:02:37 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:02:37 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:02:37 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:02:37 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:02:37 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtjpSE7gnmBQTsiBbZpMAYKACpMtwDKBi1YyBWHdC7v3Ek1x_phl4qBjBdMI7F_mIN_C1w-tJ4QvSh2wfZ-EwXS_iiFhuAadymrf6RTWBbSXuDHV81Vf2apkff75Cu1NZ-juUQWvlfVivDnJXNb_RRa04ga9TRQxNHheMbsNDTUuVgQ Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Project-Id: ecd89586cda04a249c938937bff52645 Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Project-Name: tempest-ServerActionsTestJSON-1852315175 Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecd89586cda04a249c938937bff52645"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ecd89586cda04a249c938937bff52645"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ecd89586cda04a249c938937bff52645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Tenant: tempest-ServerActionsTestJSON-1852315175 Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Tenant-Id: ecd89586cda04a249c938937bff52645 Apr 18 18:02:37 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-ServerActionsTestJSON-1852315175 Apr 18 18:02:37 user devstack@n-api.service[61068]: X-User: tempest-ServerActionsTestJSON-1852315175-project-member Apr 18 18:02:37 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:02:37 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:02:37 user devstack@n-api.service[61068]: X-User-Id: 5530d6dd1b104cd7824717aea8f429cf Apr 18 18:02:37 user devstack@n-api.service[61068]: X-User-Name: tempest-ServerActionsTestJSON-1852315175-project-member Apr 18 18:02:37 user devstack@n-api.service[61068]: method: > Apr 18 18:02:37 user devstack@n-api.service[61068]: exception: Instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 could not be found. Apr 18 18:02:37 user devstack@n-api.service[61068]: action_args: {'id': '46ff41f2-dacf-49c7-8c2e-7621fbca6af2'} Apr 18 18:02:37 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 could not be found. Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 could not be found. Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 could not be found. Apr 18 18:02:37 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:02:37 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Returning 404 to user: Instance 46ff41f2-dacf-49c7-8c2e-7621fbca6af2 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:02:37 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-db769b45-e8ed-4512-8898-9a5341c8b276 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2" status: 404 len: 111 microversion: 2.1 time: 0.044668 Apr 18 18:02:37 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 125/363] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:02:37 2023] GET /compute/v2.1/servers/46ff41f2-dacf-49c7-8c2e-7621fbca6af2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:02:37 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=10 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:37 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:37 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=4 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:37 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-62b3d050-3a69-4c96-b76d-4491ad4f0db1 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] Calling method '.version_select at 0x7fb35b0ae440>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:02:37 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-62b3d050-3a69-4c96-b76d-4491ad4f0db1 tempest-ServerActionsTestJSON-1852315175 tempest-ServerActionsTestJSON-1852315175-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368966076" status: 202 len: 0 microversion: 2.1 time: 0.030247 Apr 18 18:02:37 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 121/364] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 18:02:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368966076 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=10 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=10 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:02:57 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:02:57 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-701e8b98-3524-407b-8a6d-963ca882daea tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c" status: 200 len: 1544 microversion: 2.1 time: 0.485738 Apr 18 18:02:57 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 119/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:02:57 2023] GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c => generated 1544 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:03:01 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:03:01 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-a690b1db-21aa-4917-851a-8a41b3185da2 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087" status: 200 len: 1586 microversion: 2.20 time: 0.387808 Apr 18 18:03:01 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 126/366] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:03:01 2023] GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 => generated 1586 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:12 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:03:12 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-80c80fc9-fbe4-4307-a8b2-0d43f0be1fa4 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 200 len: 1491 microversion: 2.1 time: 0.465947 Apr 18 18:03:12 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 122/367] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:03:12 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 1491 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:57 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:58 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-e6226fa9-0372-4eb7-aa50-8e453ed6026c tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.200644 Apr 18 18:03:58 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 120/368] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 18:03:57 2023] GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c/os-interface => generated 282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:03:59 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:59 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:59 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:59 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-b36537c2-6224-4c04-8ec2-dbc7ed31b4b4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c/ips" status: 200 len: 108 microversion: 2.1 time: 0.043808 Apr 18 18:03:59 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 123/369] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 18:03:59 2023] GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c/ips => generated 108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:03:59 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-e939675d-6262-483b-894b-34fe9aeda943 req-07aa5082-5f16-43c7-a0b2-d723be799e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03edc06-3774-4d88-82f8-f9f83e82230c", "tag": "5f0a4b88-d443-4e86-9b18-6f7dcfb74aea"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:03:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-e939675d-6262-483b-894b-34fe9aeda943 req-07aa5082-5f16-43c7-a0b2-d723be799e5b service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:03:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-e939675d-6262-483b-894b-34fe9aeda943 req-07aa5082-5f16-43c7-a0b2-d723be799e5b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:03:59 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-e939675d-6262-483b-894b-34fe9aeda943 req-07aa5082-5f16-43c7-a0b2-d723be799e5b service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:03:59 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-e939675d-6262-483b-894b-34fe9aeda943 req-07aa5082-5f16-43c7-a0b2-d723be799e5b service nova] Creating event network-changed:5f0a4b88-d443-4e86-9b18-6f7dcfb74aea for instance f03edc06-3774-4d88-82f8-f9f83e82230c on user Apr 18 18:03:59 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-e939675d-6262-483b-894b-34fe9aeda943 req-07aa5082-5f16-43c7-a0b2-d723be799e5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148931 Apr 18 18:03:59 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 127/370] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:03:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:00 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Going to try to terminate instance {{(pid=61070) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:04:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-52e58ccf-c517-4ee9-9b5c-9d78013d77ce tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c" status: 204 len: 0 microversion: 2.1 time: 0.114566 Apr 18 18:04:01 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 121/371] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:04:00 2023] DELETE /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:01 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-9dd525d7-460c-4d15-a134-e3d6aacb9f10 req-a3776f78-a739-4b51-b222-fdaf0a91f195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03edc06-3774-4d88-82f8-f9f83e82230c", "name": "network-vif-unplugged", "status": "completed", "tag": "5f0a4b88-d443-4e86-9b18-6f7dcfb74aea"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:01 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-9dd525d7-460c-4d15-a134-e3d6aacb9f10 req-a3776f78-a739-4b51-b222-fdaf0a91f195 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-9dd525d7-460c-4d15-a134-e3d6aacb9f10 req-a3776f78-a739-4b51-b222-fdaf0a91f195 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:01 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-9dd525d7-460c-4d15-a134-e3d6aacb9f10 req-a3776f78-a739-4b51-b222-fdaf0a91f195 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:01 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-42ea2130-2eb5-4272-843a-6db56e5413ff tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c" status: 200 len: 1668 microversion: 2.1 time: 0.380899 Apr 18 18:04:01 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 124/372] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:04:01 2023] GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c => generated 1668 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:04:01 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-9dd525d7-460c-4d15-a134-e3d6aacb9f10 req-a3776f78-a739-4b51-b222-fdaf0a91f195 service nova] Creating event network-vif-unplugged:5f0a4b88-d443-4e86-9b18-6f7dcfb74aea for instance f03edc06-3774-4d88-82f8-f9f83e82230c on user Apr 18 18:04:01 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-9dd525d7-460c-4d15-a134-e3d6aacb9f10 req-a3776f78-a739-4b51-b222-fdaf0a91f195 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093559 Apr 18 18:04:01 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 128/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:02 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-e606fd8a-a38f-4c8d-b1fa-01d28946ad76 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.177018 Apr 18 18:04:02 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 122/374] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 18:04:01 2023] GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087/os-interface => generated 282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 18:04:02 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-006e9ab4-f7a6-4936-89f6-ff496ed3ed7d req-7aec3589-e746-4e27-bafd-dbe7176799ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03edc06-3774-4d88-82f8-f9f83e82230c", "name": "network-vif-deleted", "tag": "5f0a4b88-d443-4e86-9b18-6f7dcfb74aea"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:02 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-006e9ab4-f7a6-4936-89f6-ff496ed3ed7d req-7aec3589-e746-4e27-bafd-dbe7176799ec service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:02 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-006e9ab4-f7a6-4936-89f6-ff496ed3ed7d req-7aec3589-e746-4e27-bafd-dbe7176799ec service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:02 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-006e9ab4-f7a6-4936-89f6-ff496ed3ed7d req-7aec3589-e746-4e27-bafd-dbe7176799ec service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:02 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-006e9ab4-f7a6-4936-89f6-ff496ed3ed7d req-7aec3589-e746-4e27-bafd-dbe7176799ec service nova] Creating event network-vif-deleted:5f0a4b88-d443-4e86-9b18-6f7dcfb74aea for instance f03edc06-3774-4d88-82f8-f9f83e82230c on user Apr 18 18:04:02 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-006e9ab4-f7a6-4936-89f6-ff496ed3ed7d req-7aec3589-e746-4e27-bafd-dbe7176799ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081328 Apr 18 18:04:02 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 125/375] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:02 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-fa9437c1-a380-43af-8eab-88751c4548f0 req-697d43e8-a848-4d2b-8be5-9987c79e4874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:02 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-fa9437c1-a380-43af-8eab-88751c4548f0 req-697d43e8-a848-4d2b-8be5-9987c79e4874 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:02 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-fa9437c1-a380-43af-8eab-88751c4548f0 req-697d43e8-a848-4d2b-8be5-9987c79e4874 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:02 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-fa9437c1-a380-43af-8eab-88751c4548f0 req-697d43e8-a848-4d2b-8be5-9987c79e4874 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:02 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-fa9437c1-a380-43af-8eab-88751c4548f0 req-697d43e8-a848-4d2b-8be5-9987c79e4874 service nova] Creating event network-changed:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:02 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-fa9437c1-a380-43af-8eab-88751c4548f0 req-697d43e8-a848-4d2b-8be5-9987c79e4874 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031348 Apr 18 18:04:02 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 129/376] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:03 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:03 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-858a91cc-829b-45ea-9d7f-5d365ad09bc6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087/ips" status: 200 len: 110 microversion: 2.20 time: 0.038706 Apr 18 18:04:03 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 123/377] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 18:04:03 2023] GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087/ips => generated 110 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 18:04:03 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-1e6f3e53-af96-4143-8b60-9bf937391e02 req-33d2e821-ce19-49d9-aaba-c2728e6e551f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03edc06-3774-4d88-82f8-f9f83e82230c", "name": "network-vif-plugged", "status": "completed", "tag": "5f0a4b88-d443-4e86-9b18-6f7dcfb74aea"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-1e6f3e53-af96-4143-8b60-9bf937391e02 req-33d2e821-ce19-49d9-aaba-c2728e6e551f service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-1e6f3e53-af96-4143-8b60-9bf937391e02 req-33d2e821-ce19-49d9-aaba-c2728e6e551f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:03 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-1e6f3e53-af96-4143-8b60-9bf937391e02 req-33d2e821-ce19-49d9-aaba-c2728e6e551f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:03 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-1e6f3e53-af96-4143-8b60-9bf937391e02 req-33d2e821-ce19-49d9-aaba-c2728e6e551f service nova] Creating event network-vif-plugged:5f0a4b88-d443-4e86-9b18-6f7dcfb74aea for instance f03edc06-3774-4d88-82f8-f9f83e82230c on user Apr 18 18:04:03 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-1e6f3e53-af96-4143-8b60-9bf937391e02 req-33d2e821-ce19-49d9-aaba-c2728e6e551f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029960 Apr 18 18:04:03 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 126/378] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:04 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:04:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-328c36e4-82d0-4407-b0e5-6f4f2b93fe06 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087" status: 204 len: 0 microversion: 2.20 time: 0.118105 Apr 18 18:04:04 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 130/379] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 18:04:04 2023] DELETE /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:04 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:04 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-49688f91-cc43-4771-ac43-f5baaba9f694 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087" status: 200 len: 1710 microversion: 2.20 time: 0.238475 Apr 18 18:04:04 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 124/380] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:04:04 2023] GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 => generated 1710 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:04:05 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-unplugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}, {"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-plugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}, {"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-plugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:05 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:05 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:05 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:05 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] Creating event network-vif-unplugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:05 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] Creating event network-vif-plugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:05 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] Creating event network-vif-plugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:05 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-6cf56a92-f958-4990-8a1b-5338a05a1f27 req-44b980e9-eeba-4370-9ec5-3937039c3c71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.038518 Apr 18 18:04:05 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 127/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:05 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:06 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-6787bef7-0880-4866-b8aa-9571468223de req-5c58854a-d7f0-412c-9f7a-da2c27be9de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-deleted", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-6787bef7-0880-4866-b8aa-9571468223de req-5c58854a-d7f0-412c-9f7a-da2c27be9de6 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-6787bef7-0880-4866-b8aa-9571468223de req-5c58854a-d7f0-412c-9f7a-da2c27be9de6 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:06 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-6787bef7-0880-4866-b8aa-9571468223de req-5c58854a-d7f0-412c-9f7a-da2c27be9de6 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:06 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-6787bef7-0880-4866-b8aa-9571468223de req-5c58854a-d7f0-412c-9f7a-da2c27be9de6 service nova] Creating event network-vif-deleted:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:06 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-6787bef7-0880-4866-b8aa-9571468223de req-5c58854a-d7f0-412c-9f7a-da2c27be9de6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Apr 18 18:04:06 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 131/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:07 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-plugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}, {"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-unplugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}, {"server_uuid": "6826dd0b-4e47-463e-8d5e-6733cf3fd087", "name": "network-vif-plugged", "status": "completed", "tag": "5e91d48d-d3cb-4513-a606-7ec8e7cedbae"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:07 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:07 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:07 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:07 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] Creating event network-vif-plugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:07 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] Creating event network-vif-unplugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:07 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] Creating event network-vif-plugged:5e91d48d-d3cb-4513-a606-7ec8e7cedbae for instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 on user Apr 18 18:04:07 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-c095b92d-4b95-4987-98bb-a6fb5fbdfa89 req-abdf0fa6-e40f-4394-ace8-28ce83b921d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.037159 Apr 18 18:04:07 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 125/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:12 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:13 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:13 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-1cdfddcb-2e87-4bde-a04a-6d875acbffc9 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 200 len: 1491 microversion: 2.1 time: 0.615101 Apr 18 18:04:13 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 128/384] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:04:12 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 1491 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:04:51 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c HTTP/1.1 Apr 18 18:04:51 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:04:51 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:04:51 user devstack@n-api.service[61068]: Connection: close Apr 18 18:04:51 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:04:51 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:04:51 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:04:51 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:04:51 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:04:51 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:04:51 user devstack@n-api.service[61068]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:04:51 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:04:51 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:04:51 user devstack@n-api.service[61068]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:04:51 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:04:51 user devstack@n-api.service[61068]: method: > Apr 18 18:04:51 user devstack@n-api.service[61068]: exception: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:04:51 user devstack@n-api.service[61068]: action_args: {'id': 'f03edc06-3774-4d88-82f8-f9f83e82230c'} Apr 18 18:04:51 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:04:51 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:04:51 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:04:51 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-865024ee-a2f9-4246-a151-5f1baf28939e tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c" status: 404 len: 111 microversion: 2.1 time: 0.036865 Apr 18 18:04:51 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 132/385] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:04:51 2023] GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:04:51 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:04:51 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:04:51 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-3ebc9a2a-cf69-4812-a5ee-06edd0e55d22 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '.version_select at 0x7fb35bdd3d90>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:51 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-3ebc9a2a-cf69-4812-a5ee-06edd0e55d22 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641272335" status: 202 len: 0 microversion: 2.1 time: 0.034851 Apr 18 18:04:51 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 126/386] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 18:04:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641272335 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 18:04:52 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-802943a3-fbf6-48f9-9ab5-a253fd1b7552 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Action: 'create', calling method: .version_select at 0x7fb35b0ac310>, body: {"keypair": {"name": "tempest-keypair-987563154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUDNj3gaM6+yX1tonvN8mX0unvOVAZOKnQkLOjA4mqY8rTANjYcTBCYZyWfGQzERf3oAG+QbcL8ca8kQrPY40r8d0XEcIFtcE46WGJFRAgOlsXLFPa6ANWhTA1KtPfxXw=="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:52 user devstack@n-api.service[61069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 18:04:52 user devstack@n-api.service[61069]: Tue Apr 18 18:04:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 18 18:04:52 user devstack@n-api.service[61069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 18:04:52 user devstack@n-api.service[61069]: Tue Apr 18 18:04:52 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 18 18:04:52 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=12 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:04:52 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=22 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:04:52 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-802943a3-fbf6-48f9-9ab5-a253fd1b7552 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:04:52 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-802943a3-fbf6-48f9-9ab5-a253fd1b7552 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for user 3da8052dbf914e1cb2ee508d2bb21bd7 and project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:04:52 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-802943a3-fbf6-48f9-9ab5-a253fd1b7552 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056429 Apr 18 18:04:52 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 129/387] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 18:04:52 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-159146497", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "56ee566b-b65a-4747-a0ad-917fef191e6f"}], "security_groups": [{"name": "tempest-securitygroup--4010587"}], "key_name": "tempest-keypair-987563154", "user_data": "}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] validate_networks() for [('56ee566b-b65a-4747-a0ad-917fef191e6f', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for user 3da8052dbf914e1cb2ee508d2bb21bd7 and project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 18:04:54 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:54 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] HTTP exception thrown: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Request method failure captured: Apr 18 18:04:54 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 HTTP/1.1 Apr 18 18:04:54 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:04:54 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:04:54 user devstack@n-api.service[61070]: Connection: close Apr 18 18:04:54 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:04:54 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:04:54 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:04:54 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:04:54 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtsgiYsSmemSxSjbmM6ZXIXqHZrDt7era-4qfnDvVWw_tDUaEKM9ON69vzpDu_pjO2d_HVYeBQwUagX5KKBiQKFIvtWPpIhKvzuYN-WQ3PXrFbCDmnjKOe_G9w0GYiOAjDuOO_nxI2gJIGRGG_ESTV0vVeDXBOKAZ3LueNoK19kprXk Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Project-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Tenant-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:04:54 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:04:54 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:04:54 user devstack@n-api.service[61070]: X-User-Id: 2169669cc67547a18bf80a0eb08b39b0 Apr 18 18:04:54 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:04:54 user devstack@n-api.service[61070]: method: > Apr 18 18:04:54 user devstack@n-api.service[61070]: exception: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:04:54 user devstack@n-api.service[61070]: action_args: {'id': '6826dd0b-4e47-463e-8d5e-6733cf3fd087'} Apr 18 18:04:54 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:04:54 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:04:54 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Returning 404 to user: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:04:54 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-9f14e2da-31af-4450-9986-595a13d5d2b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087" status: 404 len: 111 microversion: 2.20 time: 0.029567 Apr 18 18:04:54 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 127/388] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:04:54 2023] GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:04:54 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-bcef2683-f352-4b8c-b520-08dcfe6ab59d tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '.version_select at 0x7fb35b0ac4c0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:55 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-bcef2683-f352-4b8c-b520-08dcfe6ab59d tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-395164576" status: 204 len: 0 microversion: 2.20 time: 0.023073 Apr 18 18:04:55 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 130/389] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 18 18:04:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-395164576 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 18:04:55 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-25627a19-fb44-4185-a270-64240dee84b9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 397 microversion: 2.1 time: 0.788961 Apr 18 18:04:55 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 133/390] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 18:04:54 2023] POST /compute/v2.1/servers => generated 397 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 18:04:55 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-ccc8b984-9439-4e3a-9316-ca62ac8ca4d6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:55 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-ccc8b984-9439-4e3a-9316-ca62ac8ca4d6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:55 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-ccc8b984-9439-4e3a-9316-ca62ac8ca4d6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:55 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-ccc8b984-9439-4e3a-9316-ca62ac8ca4d6 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913" status: 200 len: 1234 microversion: 2.1 time: 0.069060 Apr 18 18:04:55 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 128/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:04:55 2023] GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 => generated 1234 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:04:55 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-93e6ae4b-2d58-40d3-829a-dfd654bc34b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Action: 'create', calling method: .version_select at 0x7fb35af54f70>, body: {"keypair": {"name": "tempest-keypair-1760804614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBqxJPIW8ouBer2ATT+JmEQxrpJm8wH2rx/V1T3hDymOZPVRYQvPV8II5JlwplTJvrM7DGtN3zMW+U4MI9z2FUrDp4CgyHBAbxIaYsTm9AbiRSzkXB/nclAZPMAsXeB7w=="}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:55 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-93e6ae4b-2d58-40d3-829a-dfd654bc34b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for project bd90ac6164a645e1829a7c53dc58f906. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:04:55 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-93e6ae4b-2d58-40d3-829a-dfd654bc34b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for user 2169669cc67547a18bf80a0eb08b39b0 and project bd90ac6164a645e1829a7c53dc58f906. Resources: {'key_pairs'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:04:55 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-93e6ae4b-2d58-40d3-829a-dfd654bc34b4 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044863 Apr 18 18:04:55 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 131/392] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 18:04:55 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 18:04:57 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-889912124", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "26dbb1c5-e7b6-45d6-803a-31acef317435"}], "security_groups": [{"name": "tempest-securitygroup--731376675"}], "key_name": "tempest-keypair-1760804614", "user_data": "}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:57 user devstack@n-api.service[61068]: DEBUG nova.network.neutron [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] validate_networks() for [('26dbb1c5-e7b6-45d6-803a-31acef317435', None, None, None, None, None)] {{(pid=61068) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Flavor limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Image limits 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Flavor pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Image pref 0:0:0 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.virt.hardware [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for project bd90ac6164a645e1829a7c53dc58f906. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Getting quotas for user 2169669cc67547a18bf80a0eb08b39b0 and project bd90ac6164a645e1829a7c53dc58f906. Resources: {'ram', 'cores', 'instances'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Going to run 1 instances... {{(pid=61068) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 18:04:58 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 18:04:58 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-ff542d5e-92b1-4b4e-a6fc-11277a088781 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.588263 Apr 18 18:04:58 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 134/393] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 18:04:57 2023] POST /compute/v2.1/servers => generated 399 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 18:04:58 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-5c78a7e5-cd45-4336-9bcb-271c0f23f9d0 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:04:58 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-5c78a7e5-cd45-4336-9bcb-271c0f23f9d0 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:04:58 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-5c78a7e5-cd45-4336-9bcb-271c0f23f9d0 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:58 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-5c78a7e5-cd45-4336-9bcb-271c0f23f9d0 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:58 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-5c78a7e5-cd45-4336-9bcb-271c0f23f9d0 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:04:58 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-5c78a7e5-cd45-4336-9bcb-271c0f23f9d0 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30" status: 200 len: 1275 microversion: 2.20 time: 0.064313 Apr 18 18:04:58 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 129/394] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:04:58 2023] GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 => generated 1275 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:04:58 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-8a18ad52-a019-492f-b7b6-fa83c561a687 req-776816e0-bf5b-4b00-9b6c-5ebd93540256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:04:58 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8a18ad52-a019-492f-b7b6-fa83c561a687 req-776816e0-bf5b-4b00-9b6c-5ebd93540256 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:04:58 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8a18ad52-a019-492f-b7b6-fa83c561a687 req-776816e0-bf5b-4b00-9b6c-5ebd93540256 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:04:58 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-8a18ad52-a019-492f-b7b6-fa83c561a687 req-776816e0-bf5b-4b00-9b6c-5ebd93540256 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:04:58 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-8a18ad52-a019-492f-b7b6-fa83c561a687 req-776816e0-bf5b-4b00-9b6c-5ebd93540256 service nova] Creating event network-changed:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:04:58 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-8a18ad52-a019-492f-b7b6-fa83c561a687 req-776816e0-bf5b-4b00-9b6c-5ebd93540256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028345 Apr 18 18:04:58 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:04:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:05:00 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-592be5b2-4cde-4a9b-ae57-a55f20686375 req-2688a0cd-c498-42b8-8518-72723b39340c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-plugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:05:00 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-592be5b2-4cde-4a9b-ae57-a55f20686375 req-2688a0cd-c498-42b8-8518-72723b39340c service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:00 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-592be5b2-4cde-4a9b-ae57-a55f20686375 req-2688a0cd-c498-42b8-8518-72723b39340c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:00 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-592be5b2-4cde-4a9b-ae57-a55f20686375 req-2688a0cd-c498-42b8-8518-72723b39340c service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:00 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-592be5b2-4cde-4a9b-ae57-a55f20686375 req-2688a0cd-c498-42b8-8518-72723b39340c service nova] Creating event network-vif-plugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:05:00 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-592be5b2-4cde-4a9b-ae57-a55f20686375 req-2688a0cd-c498-42b8-8518-72723b39340c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038412 Apr 18 18:05:00 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 135/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:05:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:05:01 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-cf8db21e-d688-43b8-b7ff-25cb6006b9da req-65f20506-05aa-4988-8115-62fb5a6d28df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f398c844-cdcb-4e00-9809-4d47ea1e6a30", "tag": "bdfe9daa-2131-4ff3-9e1f-84a07818c97d"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:05:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-cf8db21e-d688-43b8-b7ff-25cb6006b9da req-65f20506-05aa-4988-8115-62fb5a6d28df service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-cf8db21e-d688-43b8-b7ff-25cb6006b9da req-65f20506-05aa-4988-8115-62fb5a6d28df service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:01 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-cf8db21e-d688-43b8-b7ff-25cb6006b9da req-65f20506-05aa-4988-8115-62fb5a6d28df service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-cf8db21e-d688-43b8-b7ff-25cb6006b9da req-65f20506-05aa-4988-8115-62fb5a6d28df service nova] Creating event network-changed:bdfe9daa-2131-4ff3-9e1f-84a07818c97d for instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 on user Apr 18 18:05:01 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-cf8db21e-d688-43b8-b7ff-25cb6006b9da req-65f20506-05aa-4988-8115-62fb5a6d28df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033393 Apr 18 18:05:01 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 130/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:05:02 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-45bd1e3b-4643-4f47-a75e-d9adc032b72a req-cdd54bef-038a-4db4-978f-08d91880d976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-plugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:05:02 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-45bd1e3b-4643-4f47-a75e-d9adc032b72a req-cdd54bef-038a-4db4-978f-08d91880d976 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:02 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-45bd1e3b-4643-4f47-a75e-d9adc032b72a req-cdd54bef-038a-4db4-978f-08d91880d976 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:02 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-45bd1e3b-4643-4f47-a75e-d9adc032b72a req-cdd54bef-038a-4db4-978f-08d91880d976 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:02 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-45bd1e3b-4643-4f47-a75e-d9adc032b72a req-cdd54bef-038a-4db4-978f-08d91880d976 service nova] Creating event network-vif-plugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:05:02 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-45bd1e3b-4643-4f47-a75e-d9adc032b72a req-cdd54bef-038a-4db4-978f-08d91880d976 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035408 Apr 18 18:05:02 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 133/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:05:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:05:04 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-374971eb-a2cb-4599-b06e-8c90e6b4e68d req-9ad45fdc-86f2-4ada-b9e1-0223d320ea6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f398c844-cdcb-4e00-9809-4d47ea1e6a30", "name": "network-vif-plugged", "status": "completed", "tag": "bdfe9daa-2131-4ff3-9e1f-84a07818c97d"}, {"server_uuid": "f398c844-cdcb-4e00-9809-4d47ea1e6a30", "name": "network-vif-plugged", "status": "completed", "tag": "bdfe9daa-2131-4ff3-9e1f-84a07818c97d"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:05:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-374971eb-a2cb-4599-b06e-8c90e6b4e68d req-9ad45fdc-86f2-4ada-b9e1-0223d320ea6d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-374971eb-a2cb-4599-b06e-8c90e6b4e68d req-9ad45fdc-86f2-4ada-b9e1-0223d320ea6d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:04 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-374971eb-a2cb-4599-b06e-8c90e6b4e68d req-9ad45fdc-86f2-4ada-b9e1-0223d320ea6d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-374971eb-a2cb-4599-b06e-8c90e6b4e68d req-9ad45fdc-86f2-4ada-b9e1-0223d320ea6d service nova] Creating event network-vif-plugged:bdfe9daa-2131-4ff3-9e1f-84a07818c97d for instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 on user Apr 18 18:05:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-374971eb-a2cb-4599-b06e-8c90e6b4e68d req-9ad45fdc-86f2-4ada-b9e1-0223d320ea6d service nova] Creating event network-vif-plugged:bdfe9daa-2131-4ff3-9e1f-84a07818c97d for instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 on user Apr 18 18:05:04 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-374971eb-a2cb-4599-b06e-8c90e6b4e68d req-9ad45fdc-86f2-4ada-b9e1-0223d320ea6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033818 Apr 18 18:05:04 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 136/399] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:05:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:14 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:05:14 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-4541bdac-f70c-4ba6-9498-3ccb41113206 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 200 len: 1491 microversion: 2.1 time: 0.244753 Apr 18 18:05:14 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 131/400] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:05:14 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 1491 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=8 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=4 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:45 user devstack@n-api.service[61069]: DEBUG nova.policy [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61069) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:05:45 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-51e46a34-7b0a-4b48-a2e2-a2c2cea48b79 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913" status: 200 len: 1541 microversion: 2.1 time: 0.246598 Apr 18 18:05:45 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:05:45 2023] GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 => generated 1541 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:05:48 user devstack@n-api.service[61068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 18:05:48 user devstack@n-api.service[61068]: Tue Apr 18 18:05:48 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 (ip 10.0.0.210) !!! Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=4 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=12 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=10 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:05:48 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:05:48 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-69009474-f5fe-4c5d-8d6a-ee5f149a4753 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30" status: 200 len: 1587 microversion: 2.20 time: 0.297646 Apr 18 18:05:48 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 137/402] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:05:48 2023] GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 => generated 1587 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] HTTP exception thrown: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Request method failure captured: Apr 18 18:06:15 user devstack@n-api.service[61070]: request: DELETE /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b HTTP/1.1 Apr 18 18:06:15 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:06:15 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:06:15 user devstack@n-api.service[61070]: Connection: close Apr 18 18:06:15 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:06:15 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:06:15 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:06:15 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:06:15 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtoQZARdrKyykcAhB6sEESGBOkof7KZzLK_37Nrys6D-Wmm0zXqjOpGsR9xPouT44TARNDutifcwnYGjxq0HtcU6kkSUr96ijcAV2c9QLCGfROp9P_n1HdHbuuAjkczMK4KN5M8N6clSUcTrZF4NXDD4Y9tolDGIxMQ4CnMSprxSaCY Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Project-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Project-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Tenant: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Tenant-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:06:15 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:06:15 user devstack@n-api.service[61070]: X-User: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:06:15 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:06:15 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:06:15 user devstack@n-api.service[61070]: X-User-Id: 08887d6401f540fa9cf01c378af3c398 Apr 18 18:06:15 user devstack@n-api.service[61070]: X-User-Name: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:06:15 user devstack@n-api.service[61070]: method: > Apr 18 18:06:15 user devstack@n-api.service[61070]: exception: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61070]: action_args: {'id': 'b111bc4a-871a-4cd9-aea7-1e55ab88a55b'} Apr 18 18:06:15 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Returning 404 to user: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:06:15 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-4b35d792-9135-4c76-9a64-8bbe7545d345 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b" status: 404 len: 111 microversion: 2.1 time: 0.036108 Apr 18 18:06:15 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 132/403] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:06:15 2023] DELETE /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: b111bc4a-871a-4cd9-aea7-1e55ab88a55b] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] HTTP exception thrown: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Request method failure captured: Apr 18 18:06:15 user devstack@n-api.service[61069]: request: GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b HTTP/1.1 Apr 18 18:06:15 user devstack@n-api.service[61069]: Accept: application/json Apr 18 18:06:15 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 18:06:15 user devstack@n-api.service[61069]: Connection: close Apr 18 18:06:15 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 18:06:15 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 18:06:15 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 18:06:15 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 18:06:15 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtoQZARdrKyykcAhB6sEESGBOkof7KZzLK_37Nrys6D-Wmm0zXqjOpGsR9xPouT44TARNDutifcwnYGjxq0HtcU6kkSUr96ijcAV2c9QLCGfROp9P_n1HdHbuuAjkczMK4KN5M8N6clSUcTrZF4NXDD4Y9tolDGIxMQ4CnMSprxSaCY Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Project-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Project-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Tenant: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Tenant-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:06:15 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:06:15 user devstack@n-api.service[61069]: X-User: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:06:15 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 18:06:15 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 18:06:15 user devstack@n-api.service[61069]: X-User-Id: 08887d6401f540fa9cf01c378af3c398 Apr 18 18:06:15 user devstack@n-api.service[61069]: X-User-Name: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:06:15 user devstack@n-api.service[61069]: method: > Apr 18 18:06:15 user devstack@n-api.service[61069]: exception: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61069]: action_args: {'id': 'b111bc4a-871a-4cd9-aea7-1e55ab88a55b'} Apr 18 18:06:15 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. Apr 18 18:06:15 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Returning 404 to user: Instance b111bc4a-871a-4cd9-aea7-1e55ab88a55b could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:06:15 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-e6abf434-7ec8-484e-990c-39db2ccc3f91 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b" status: 404 len: 111 microversion: 2.1 time: 0.031985 Apr 18 18:06:15 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:06:15 2023] GET /compute/v2.1/servers/b111bc4a-871a-4cd9-aea7-1e55ab88a55b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Going to try to terminate instance {{(pid=61068) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:06:15 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-06ece9da-f4ed-47c6-923c-d1e897d08820 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 204 len: 0 microversion: 2.1 time: 0.133200 Apr 18 18:06:15 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 138/405] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:06:15 2023] DELETE /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-b1d0c5ae-873b-48ba-8477-3eecc2b11365 req-fe312ec7-215d-4b98-8cd8-a7bceb832592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4fd3db-b881-441a-90b7-b927392288fb", "name": "network-vif-unplugged", "status": "completed", "tag": "535fdace-a2a4-4073-acaa-20534cfb3050"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-b1d0c5ae-873b-48ba-8477-3eecc2b11365 req-fe312ec7-215d-4b98-8cd8-a7bceb832592 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-b1d0c5ae-873b-48ba-8477-3eecc2b11365 req-fe312ec7-215d-4b98-8cd8-a7bceb832592 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:15 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-b1d0c5ae-873b-48ba-8477-3eecc2b11365 req-fe312ec7-215d-4b98-8cd8-a7bceb832592 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:15 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-b1d0c5ae-873b-48ba-8477-3eecc2b11365 req-fe312ec7-215d-4b98-8cd8-a7bceb832592 service nova] Creating event network-vif-unplugged:535fdace-a2a4-4073-acaa-20534cfb3050 for instance 6c4fd3db-b881-441a-90b7-b927392288fb on user Apr 18 18:06:15 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-b1d0c5ae-873b-48ba-8477-3eecc2b11365 req-fe312ec7-215d-4b98-8cd8-a7bceb832592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028374 Apr 18 18:06:15 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 136/406] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:15 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08887d6401f540fa9cf01c378af3c398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df19b002da6742dbb8ed4009530e5f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:06:15 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-5ef39ca1-041d-4dc5-bfde-20574aadb11f tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 200 len: 1497 microversion: 2.1 time: 0.252720 Apr 18 18:06:15 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 133/407] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:06:15 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 1497 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:06:16 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-4c088c8f-f8a8-42b1-8eab-0a61cda58a6a req-a87a1b00-daf6-45a1-af88-b89ad0f0e69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4fd3db-b881-441a-90b7-b927392288fb", "name": "network-vif-deleted", "tag": "535fdace-a2a4-4073-acaa-20534cfb3050"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4c088c8f-f8a8-42b1-8eab-0a61cda58a6a req-a87a1b00-daf6-45a1-af88-b89ad0f0e69f service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4c088c8f-f8a8-42b1-8eab-0a61cda58a6a req-a87a1b00-daf6-45a1-af88-b89ad0f0e69f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:16 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-4c088c8f-f8a8-42b1-8eab-0a61cda58a6a req-a87a1b00-daf6-45a1-af88-b89ad0f0e69f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:16 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-4c088c8f-f8a8-42b1-8eab-0a61cda58a6a req-a87a1b00-daf6-45a1-af88-b89ad0f0e69f service nova] Creating event network-vif-deleted:535fdace-a2a4-4073-acaa-20534cfb3050 for instance 6c4fd3db-b881-441a-90b7-b927392288fb on user Apr 18 18:06:16 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-4c088c8f-f8a8-42b1-8eab-0a61cda58a6a req-a87a1b00-daf6-45a1-af88-b89ad0f0e69f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028376 Apr 18 18:06:16 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 139/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:17 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-0523a47a-1af9-4c6d-b8f6-c3d4d86fa574 req-847ebb2b-4c14-4348-a4da-dcc3ff239a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4fd3db-b881-441a-90b7-b927392288fb", "name": "network-vif-plugged", "status": "completed", "tag": "535fdace-a2a4-4073-acaa-20534cfb3050"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:17 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0523a47a-1af9-4c6d-b8f6-c3d4d86fa574 req-847ebb2b-4c14-4348-a4da-dcc3ff239a01 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:17 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0523a47a-1af9-4c6d-b8f6-c3d4d86fa574 req-847ebb2b-4c14-4348-a4da-dcc3ff239a01 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:17 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-0523a47a-1af9-4c6d-b8f6-c3d4d86fa574 req-847ebb2b-4c14-4348-a4da-dcc3ff239a01 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:17 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-0523a47a-1af9-4c6d-b8f6-c3d4d86fa574 req-847ebb2b-4c14-4348-a4da-dcc3ff239a01 service nova] Creating event network-vif-plugged:535fdace-a2a4-4073-acaa-20534cfb3050 for instance 6c4fd3db-b881-441a-90b7-b927392288fb on user Apr 18 18:06:17 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-0523a47a-1af9-4c6d-b8f6-c3d4d86fa574 req-847ebb2b-4c14-4348-a4da-dcc3ff239a01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029673 Apr 18 18:06:17 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 137/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=8 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:45 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:45 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-cc1a7850-f051-4970-a49b-17d928c38dc7 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.170915 Apr 18 18:06:45 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 134/410] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 18:06:45 2023] GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 18:06:46 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:46 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:46 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-bec603ba-52db-49ce-8e93-cf9a35ee21c5 req-99e34380-7284-45c3-b094-69eb78911ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bec603ba-52db-49ce-8e93-cf9a35ee21c5 req-99e34380-7284-45c3-b094-69eb78911ab1 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bec603ba-52db-49ce-8e93-cf9a35ee21c5 req-99e34380-7284-45c3-b094-69eb78911ab1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:46 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-bec603ba-52db-49ce-8e93-cf9a35ee21c5 req-99e34380-7284-45c3-b094-69eb78911ab1 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:46 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-bec603ba-52db-49ce-8e93-cf9a35ee21c5 req-99e34380-7284-45c3-b094-69eb78911ab1 service nova] Creating event network-changed:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:46 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-bec603ba-52db-49ce-8e93-cf9a35ee21c5 req-99e34380-7284-45c3-b094-69eb78911ab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044225 Apr 18 18:06:46 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 140/411] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:46 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-976d1d09-6c8f-4e67-9247-5bf4641ca9fc tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913/ips" status: 200 len: 108 microversion: 2.1 time: 0.039583 Apr 18 18:06:46 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 138/412] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 18:06:46 2023] GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:47 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Going to try to terminate instance {{(pid=61070) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:06:48 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-96b2fb16-2664-46f5-aefc-dc08bc0cff14 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913" status: 204 len: 0 microversion: 2.1 time: 0.107975 Apr 18 18:06:48 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 135/413] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:06:47 2023] DELETE /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:48 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-df837ace-b66c-440f-b630-2fd295aa0db8 req-f254ec09-5ad7-44ec-b219-3eeffb5d0328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-unplugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:48 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-df837ace-b66c-440f-b630-2fd295aa0db8 req-f254ec09-5ad7-44ec-b219-3eeffb5d0328 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:48 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-df837ace-b66c-440f-b630-2fd295aa0db8 req-f254ec09-5ad7-44ec-b219-3eeffb5d0328 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:48 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:06:48 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-df837ace-b66c-440f-b630-2fd295aa0db8 req-f254ec09-5ad7-44ec-b219-3eeffb5d0328 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:48 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-df837ace-b66c-440f-b630-2fd295aa0db8 req-f254ec09-5ad7-44ec-b219-3eeffb5d0328 service nova] Creating event network-vif-unplugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:48 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-3a339635-b51d-4a02-b170-b45df3b36dd4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913" status: 200 len: 1665 microversion: 2.1 time: 0.228992 Apr 18 18:06:48 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 141/414] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:06:48 2023] GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 => generated 1665 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:06:48 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-df837ace-b66c-440f-b630-2fd295aa0db8 req-f254ec09-5ad7-44ec-b219-3eeffb5d0328 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029371 Apr 18 18:06:48 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 139/415] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:49 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-cb14563b-912a-49a4-86c1-2e9bde688744 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.267509 Apr 18 18:06:49 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 136/416] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 18:06:48 2023] GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30/os-interface => generated 283 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 18:06:49 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-c8214a08-4d9b-40da-9a01-e59cbbfa1a91 req-39db4535-9f29-422f-84a6-93b7e68feb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-deleted", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:49 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c8214a08-4d9b-40da-9a01-e59cbbfa1a91 req-39db4535-9f29-422f-84a6-93b7e68feb2d service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:49 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c8214a08-4d9b-40da-9a01-e59cbbfa1a91 req-39db4535-9f29-422f-84a6-93b7e68feb2d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:49 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-c8214a08-4d9b-40da-9a01-e59cbbfa1a91 req-39db4535-9f29-422f-84a6-93b7e68feb2d service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:49 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-c8214a08-4d9b-40da-9a01-e59cbbfa1a91 req-39db4535-9f29-422f-84a6-93b7e68feb2d service nova] Creating event network-vif-deleted:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:49 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-c8214a08-4d9b-40da-9a01-e59cbbfa1a91 req-39db4535-9f29-422f-84a6-93b7e68feb2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Apr 18 18:06:49 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 142/417] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:50 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-plugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}, {"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-plugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}, {"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-plugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}, {"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-unplugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}, {"server_uuid": "724f06ff-e920-44ff-86e4-073fc26e0913", "name": "network-vif-plugged", "status": "completed", "tag": "1dadcabb-0f5d-4460-b957-991d91abbd65"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:50 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-5d3bbc2b-a1c5-47b6-9a33-d7411c50b592 req-b482edcf-01f1-4639-98ba-90c31501042f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f398c844-cdcb-4e00-9809-4d47ea1e6a30", "tag": "bdfe9daa-2131-4ff3-9e1f-84a07818c97d"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:50 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:50 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:50 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5d3bbc2b-a1c5-47b6-9a33-d7411c50b592 req-b482edcf-01f1-4639-98ba-90c31501042f service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5d3bbc2b-a1c5-47b6-9a33-d7411c50b592 req-b482edcf-01f1-4639-98ba-90c31501042f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:50 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-5d3bbc2b-a1c5-47b6-9a33-d7411c50b592 req-b482edcf-01f1-4639-98ba-90c31501042f service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Creating event network-vif-plugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Creating event network-vif-plugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Creating event network-vif-plugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Creating event network-vif-unplugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] Creating event network-vif-plugged:1dadcabb-0f5d-4460-b957-991d91abbd65 for instance 724f06ff-e920-44ff-86e4-073fc26e0913 on user Apr 18 18:06:50 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-563f5d86-bb30-4ecc-9b85-bb7de3cead5b req-ee7df160-ade8-47ed-934e-89be7421d6d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031299 Apr 18 18:06:50 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 140/418] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:50 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:50 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-5d3bbc2b-a1c5-47b6-9a33-d7411c50b592 req-b482edcf-01f1-4639-98ba-90c31501042f service nova] Creating event network-changed:bdfe9daa-2131-4ff3-9e1f-84a07818c97d for instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 on user Apr 18 18:06:50 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-5d3bbc2b-a1c5-47b6-9a33-d7411c50b592 req-b482edcf-01f1-4639-98ba-90c31501042f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028075 Apr 18 18:06:50 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 137/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:50 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:50 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-f84abb9d-a75d-4991-9f6c-d518820b93d6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30/ips" status: 200 len: 111 microversion: 2.20 time: 0.041127 Apr 18 18:06:50 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 143/420] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 18:06:50 2023] GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30/ips => generated 111 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:51 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:06:51 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-6198bb61-92b6-4309-af41-d592f9eb524a tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30" status: 204 len: 0 microversion: 2.20 time: 0.117541 Apr 18 18:06:51 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 141/421] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 18:06:51 2023] DELETE /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:51 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:52 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:06:52 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:06:52 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2169669cc67547a18bf80a0eb08b39b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd90ac6164a645e1829a7c53dc58f906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:06:52 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-aaaa3c8d-8d68-436d-8dbd-86c08b29ec52 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30" status: 200 len: 1712 microversion: 2.20 time: 0.168417 Apr 18 18:06:52 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 138/422] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:06:51 2023] GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 => generated 1712 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 18:06:52 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-22a46ca0-943a-4736-a9f4-9cd433b75e3e req-0f758977-1ff1-44ed-ab53-538a6da59588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f398c844-cdcb-4e00-9809-4d47ea1e6a30", "name": "network-vif-unplugged", "status": "completed", "tag": "bdfe9daa-2131-4ff3-9e1f-84a07818c97d"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:52 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-22a46ca0-943a-4736-a9f4-9cd433b75e3e req-0f758977-1ff1-44ed-ab53-538a6da59588 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:52 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-22a46ca0-943a-4736-a9f4-9cd433b75e3e req-0f758977-1ff1-44ed-ab53-538a6da59588 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:52 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-22a46ca0-943a-4736-a9f4-9cd433b75e3e req-0f758977-1ff1-44ed-ab53-538a6da59588 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:52 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-22a46ca0-943a-4736-a9f4-9cd433b75e3e req-0f758977-1ff1-44ed-ab53-538a6da59588 service nova] Creating event network-vif-unplugged:bdfe9daa-2131-4ff3-9e1f-84a07818c97d for instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 on user Apr 18 18:06:52 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-22a46ca0-943a-4736-a9f4-9cd433b75e3e req-0f758977-1ff1-44ed-ab53-538a6da59588 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028309 Apr 18 18:06:52 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 144/423] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:53 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-9367e9de-1ddc-4b09-9031-c72be37aea97 req-f94955a0-ea43-4c83-ace9-8f5b19fc3863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f398c844-cdcb-4e00-9809-4d47ea1e6a30", "name": "network-vif-deleted", "tag": "bdfe9daa-2131-4ff3-9e1f-84a07818c97d"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:53 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-9367e9de-1ddc-4b09-9031-c72be37aea97 req-f94955a0-ea43-4c83-ace9-8f5b19fc3863 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:53 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-9367e9de-1ddc-4b09-9031-c72be37aea97 req-f94955a0-ea43-4c83-ace9-8f5b19fc3863 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:53 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-9367e9de-1ddc-4b09-9031-c72be37aea97 req-f94955a0-ea43-4c83-ace9-8f5b19fc3863 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:53 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-9367e9de-1ddc-4b09-9031-c72be37aea97 req-f94955a0-ea43-4c83-ace9-8f5b19fc3863 service nova] Creating event network-vif-deleted:bdfe9daa-2131-4ff3-9e1f-84a07818c97d for instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 on user Apr 18 18:06:53 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-9367e9de-1ddc-4b09-9031-c72be37aea97 req-f94955a0-ea43-4c83-ace9-8f5b19fc3863 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027765 Apr 18 18:06:53 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 142/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:06:54 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-a17dc158-d479-44f9-a176-1e530da5ea0a req-43d2c103-d803-4ebd-ac47-8f499dba6b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f398c844-cdcb-4e00-9809-4d47ea1e6a30", "name": "network-vif-plugged", "status": "completed", "tag": "bdfe9daa-2131-4ff3-9e1f-84a07818c97d"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:06:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-a17dc158-d479-44f9-a176-1e530da5ea0a req-43d2c103-d803-4ebd-ac47-8f499dba6b23 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:06:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-a17dc158-d479-44f9-a176-1e530da5ea0a req-43d2c103-d803-4ebd-ac47-8f499dba6b23 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:06:54 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-a17dc158-d479-44f9-a176-1e530da5ea0a req-43d2c103-d803-4ebd-ac47-8f499dba6b23 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:06:54 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-a17dc158-d479-44f9-a176-1e530da5ea0a req-43d2c103-d803-4ebd-ac47-8f499dba6b23 service nova] Creating event network-vif-plugged:bdfe9daa-2131-4ff3-9e1f-84a07818c97d for instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 on user Apr 18 18:06:54 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-a17dc158-d479-44f9-a176-1e530da5ea0a req-43d2c103-d803-4ebd-ac47-8f499dba6b23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034013 Apr 18 18:06:54 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 139/425] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=10 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=16 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] [instance: 6c4fd3db-b881-441a-90b7-b927392288fb] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:05 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] HTTP exception thrown: Instance 6c4fd3db-b881-441a-90b7-b927392288fb could not be found. Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Request method failure captured: Apr 18 18:07:05 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb HTTP/1.1 Apr 18 18:07:05 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:07:05 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:07:05 user devstack@n-api.service[61068]: Connection: close Apr 18 18:07:05 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:07:05 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:07:05 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:07:05 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:07:05 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtoQZARdrKyykcAhB6sEESGBOkof7KZzLK_37Nrys6D-Wmm0zXqjOpGsR9xPouT44TARNDutifcwnYGjxq0HtcU6kkSUr96ijcAV2c9QLCGfROp9P_n1HdHbuuAjkczMK4KN5M8N6clSUcTrZF4NXDD4Y9tolDGIxMQ4CnMSprxSaCY Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Project-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Project-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df19b002da6742dbb8ed4009530e5f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Tenant: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Tenant-Id: df19b002da6742dbb8ed4009530e5f20 Apr 18 18:07:05 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1136705687 Apr 18 18:07:05 user devstack@n-api.service[61068]: X-User: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:07:05 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:07:05 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:07:05 user devstack@n-api.service[61068]: X-User-Id: 08887d6401f540fa9cf01c378af3c398 Apr 18 18:07:05 user devstack@n-api.service[61068]: X-User-Name: tempest-ServersNegativeTestJSON-1136705687-project-member Apr 18 18:07:05 user devstack@n-api.service[61068]: method: > Apr 18 18:07:05 user devstack@n-api.service[61068]: exception: Instance 6c4fd3db-b881-441a-90b7-b927392288fb could not be found. Apr 18 18:07:05 user devstack@n-api.service[61068]: action_args: {'id': '6c4fd3db-b881-441a-90b7-b927392288fb'} Apr 18 18:07:05 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4fd3db-b881-441a-90b7-b927392288fb could not be found. Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4fd3db-b881-441a-90b7-b927392288fb could not be found. Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4fd3db-b881-441a-90b7-b927392288fb could not be found. Apr 18 18:07:05 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:05 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] Returning 404 to user: Instance 6c4fd3db-b881-441a-90b7-b927392288fb could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:07:05 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-74ab4e4d-b376-4e6a-a3f8-6707c90902a1 tempest-ServersNegativeTestJSON-1136705687 tempest-ServersNegativeTestJSON-1136705687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb" status: 404 len: 111 microversion: 2.1 time: 0.039374 Apr 18 18:07:05 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 145/426] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:07:05 2023] GET /compute/v2.1/servers/6c4fd3db-b881-441a-90b7-b927392288fb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:38 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:07:38 user devstack@n-api.service[61069]: request: GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 HTTP/1.1 Apr 18 18:07:38 user devstack@n-api.service[61069]: Accept: application/json Apr 18 18:07:38 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 18:07:38 user devstack@n-api.service[61069]: Connection: close Apr 18 18:07:38 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 18:07:38 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 18:07:38 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 18:07:38 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 18:07:38 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:07:38 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:07:38 user devstack@n-api.service[61069]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:07:38 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 18:07:38 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 18:07:38 user devstack@n-api.service[61069]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:07:38 user devstack@n-api.service[61069]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:07:38 user devstack@n-api.service[61069]: method: > Apr 18 18:07:38 user devstack@n-api.service[61069]: exception: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:07:38 user devstack@n-api.service[61069]: action_args: {'id': '724f06ff-e920-44ff-86e4-073fc26e0913'} Apr 18 18:07:38 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:07:38 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:38 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:07:38 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-449a3949-0e20-4a1e-8b08-934ac6bb1ad8 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913" status: 404 len: 111 microversion: 2.1 time: 0.263709 Apr 18 18:07:38 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 143/427] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:07:38 2023] GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 => generated 111 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:07:38 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-cd67521a-dff1-4b11-9efe-d7c7b3201ad9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '.version_select at 0x7fb35b3ebac0>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:38 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:38 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:38 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-cd67521a-dff1-4b11-9efe-d7c7b3201ad9 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987563154" status: 202 len: 0 microversion: 2.1 time: 0.037178 Apr 18 18:07:38 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 140/428] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 18:07:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987563154 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 18:07:39 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-20021a89-9bec-46c6-9738-705d6fd64208 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Action: 'create', calling method: .version_select at 0x7fb35af26950>, body: {"keypair": {"name": "tempest-keypair-1830016687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3/k9C36KItoEzkjnUZ+oB22s2VV8TMYBjJmAXJBB8K+NNX9oYKSuehKbgqCLe/9sgQxi0BHAesXHDPcW605am15JLlOuzdCtwNPNIg9/cAs6z9cHC1s99M0QUIaJ+D8g=="}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:07:39 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:39 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:07:39 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-20021a89-9bec-46c6-9738-705d6fd64208 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:07:39 user devstack@n-api.service[61068]: DEBUG nova.quota [None req-20021a89-9bec-46c6-9738-705d6fd64208 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for user 3da8052dbf914e1cb2ee508d2bb21bd7 and project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'key_pairs'} {{(pid=61068) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:07:39 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-20021a89-9bec-46c6-9738-705d6fd64208 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086479 Apr 18 18:07:39 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 146/429] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 18:07:39 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:07:40 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1483130823", "imageRef": "282872e1-d44a-4a3c-af6c-9d97bb9a2b33", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "56ee566b-b65a-4747-a0ad-917fef191e6f"}], "security_groups": [{"name": "tempest-securitygroup--1441484129"}], "key_name": "tempest-keypair-1830016687", "user_data": "}} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.network.neutron [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] validate_networks() for [('56ee566b-b65a-4747-a0ad-917fef191e6f', None, None, None, None, None)] {{(pid=61069) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Flavor limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Image limits 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Flavor pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Image pref 0:0:0 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.virt.hardware [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.quota [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Getting quotas for user 3da8052dbf914e1cb2ee508d2bb21bd7 and project 26fc84542bc54be0b4ed144b4bd80820. Resources: {'ram', 'cores', 'instances'} {{(pid=61069) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Going to run 1 instances... {{(pid=61069) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 18:07:41 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='282872e1-d44a-4a3c-af6c-9d97bb9a2b33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 18:07:42 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-d473918a-ae3d-4273-8b77-6aab2d285d9a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.130343 Apr 18 18:07:42 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 144/430] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 18:07:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 18:07:42 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-53cad5bc-fda4-42ee-9cfe-29893ea27225 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:42 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-53cad5bc-fda4-42ee-9cfe-29893ea27225 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:42 user devstack@n-api.service[61070]: DEBUG nova.policy [None req-53cad5bc-fda4-42ee-9cfe-29893ea27225 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61070) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:07:42 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-53cad5bc-fda4-42ee-9cfe-29893ea27225 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8" status: 200 len: 1236 microversion: 2.1 time: 0.073467 Apr 18 18:07:42 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 141/431] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:07:42 2023] GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] HTTP exception thrown: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Request method failure captured: Apr 18 18:07:42 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 HTTP/1.1 Apr 18 18:07:42 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:07:42 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:07:42 user devstack@n-api.service[61068]: Connection: close Apr 18 18:07:42 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:07:42 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:07:42 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:07:42 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:07:42 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtsgiYsSmemSxSjbmM6ZXIXqHZrDt7era-4qfnDvVWw_tDUaEKM9ON69vzpDu_pjO2d_HVYeBQwUagX5KKBiQKFIvtWPpIhKvzuYN-WQ3PXrFbCDmnjKOe_G9w0GYiOAjDuOO_nxI2gJIGRGG_ESTV0vVeDXBOKAZ3LueNoK19kprXk Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Project-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Tenant-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-User: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:42 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:07:42 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:07:42 user devstack@n-api.service[61068]: X-User-Id: 2169669cc67547a18bf80a0eb08b39b0 Apr 18 18:07:42 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:42 user devstack@n-api.service[61068]: method: > Apr 18 18:07:42 user devstack@n-api.service[61068]: exception: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:42 user devstack@n-api.service[61068]: action_args: {'id': 'f398c844-cdcb-4e00-9809-4d47ea1e6a30'} Apr 18 18:07:42 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:42 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:42 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Returning 404 to user: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:07:42 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-f8349651-ce74-4c8d-828c-b30215c73cd6 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30" status: 404 len: 111 microversion: 2.20 time: 0.149810 Apr 18 18:07:42 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 147/432] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:07:42 2023] GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:07:42 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-6543cd7c-d290-406d-8657-6815069a524b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '.version_select at 0x7fb35b0ad6c0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:42 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-6543cd7c-d290-406d-8657-6815069a524b tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760804614" status: 204 len: 0 microversion: 2.20 time: 0.022949 Apr 18 18:07:42 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 145/433] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 18:07:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760804614 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] HTTP exception thrown: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Request method failure captured: Apr 18 18:07:43 user devstack@n-api.service[61070]: request: DELETE /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 HTTP/1.1 Apr 18 18:07:43 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:07:43 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:07:43 user devstack@n-api.service[61070]: Connection: close Apr 18 18:07:43 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:07:43 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:07:43 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:07:43 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:07:43 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtsgiYsSmemSxSjbmM6ZXIXqHZrDt7era-4qfnDvVWw_tDUaEKM9ON69vzpDu_pjO2d_HVYeBQwUagX5KKBiQKFIvtWPpIhKvzuYN-WQ3PXrFbCDmnjKOe_G9w0GYiOAjDuOO_nxI2gJIGRGG_ESTV0vVeDXBOKAZ3LueNoK19kprXk Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Tenant-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Id: 2169669cc67547a18bf80a0eb08b39b0 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61070]: method: > Apr 18 18:07:43 user devstack@n-api.service[61070]: exception: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: action_args: {'id': 'f398c844-cdcb-4e00-9809-4d47ea1e6a30'} Apr 18 18:07:43 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Returning 404 to user: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:07:43 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-4fa5dd53-aeeb-4a9f-85a8-0bc79de61a31 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30" status: 404 len: 111 microversion: 2.20 time: 0.030545 Apr 18 18:07:43 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 142/434] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 18:07:43 2023] DELETE /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: f398c844-cdcb-4e00-9809-4d47ea1e6a30] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] HTTP exception thrown: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Request method failure captured: Apr 18 18:07:43 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 HTTP/1.1 Apr 18 18:07:43 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:07:43 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:07:43 user devstack@n-api.service[61068]: Connection: close Apr 18 18:07:43 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:07:43 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:07:43 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:07:43 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:07:43 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtsgiYsSmemSxSjbmM6ZXIXqHZrDt7era-4qfnDvVWw_tDUaEKM9ON69vzpDu_pjO2d_HVYeBQwUagX5KKBiQKFIvtWPpIhKvzuYN-WQ3PXrFbCDmnjKOe_G9w0GYiOAjDuOO_nxI2gJIGRGG_ESTV0vVeDXBOKAZ3LueNoK19kprXk Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Project-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Tenant-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-User: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61068]: X-User-Id: 2169669cc67547a18bf80a0eb08b39b0 Apr 18 18:07:43 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61068]: method: > Apr 18 18:07:43 user devstack@n-api.service[61068]: exception: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61068]: action_args: {'id': 'f398c844-cdcb-4e00-9809-4d47ea1e6a30'} Apr 18 18:07:43 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Returning 404 to user: Instance f398c844-cdcb-4e00-9809-4d47ea1e6a30 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:07:43 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-802bb965-b6d6-460c-8dc8-853401ecd0c1 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30" status: 404 len: 111 microversion: 2.20 time: 0.034230 Apr 18 18:07:43 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 148/435] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:07:43 2023] GET /compute/v2.1/servers/f398c844-cdcb-4e00-9809-4d47ea1e6a30 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] HTTP exception thrown: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Request method failure captured: Apr 18 18:07:43 user devstack@n-api.service[61069]: request: DELETE /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 HTTP/1.1 Apr 18 18:07:43 user devstack@n-api.service[61069]: Accept: application/json Apr 18 18:07:43 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 18:07:43 user devstack@n-api.service[61069]: Connection: close Apr 18 18:07:43 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 18:07:43 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 18:07:43 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 18:07:43 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 18:07:43 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtsgiYsSmemSxSjbmM6ZXIXqHZrDt7era-4qfnDvVWw_tDUaEKM9ON69vzpDu_pjO2d_HVYeBQwUagX5KKBiQKFIvtWPpIhKvzuYN-WQ3PXrFbCDmnjKOe_G9w0GYiOAjDuOO_nxI2gJIGRGG_ESTV0vVeDXBOKAZ3LueNoK19kprXk Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Project-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Tenant-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-User: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61069]: X-User-Id: 2169669cc67547a18bf80a0eb08b39b0 Apr 18 18:07:43 user devstack@n-api.service[61069]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61069]: method: > Apr 18 18:07:43 user devstack@n-api.service[61069]: exception: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61069]: action_args: {'id': '6826dd0b-4e47-463e-8d5e-6733cf3fd087'} Apr 18 18:07:43 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Returning 404 to user: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:07:43 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-2f77035d-c25a-4df9-bacb-c3e360296436 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087" status: 404 len: 111 microversion: 2.20 time: 0.027417 Apr 18 18:07:43 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 146/436] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 18:07:43 2023] DELETE /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] [instance: 6826dd0b-4e47-463e-8d5e-6733cf3fd087] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:43 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] HTTP exception thrown: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Request method failure captured: Apr 18 18:07:43 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 HTTP/1.1 Apr 18 18:07:43 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:07:43 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:07:43 user devstack@n-api.service[61070]: Connection: close Apr 18 18:07:43 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:07:43 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:07:43 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:07:43 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:07:43 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtsgiYsSmemSxSjbmM6ZXIXqHZrDt7era-4qfnDvVWw_tDUaEKM9ON69vzpDu_pjO2d_HVYeBQwUagX5KKBiQKFIvtWPpIhKvzuYN-WQ3PXrFbCDmnjKOe_G9w0GYiOAjDuOO_nxI2gJIGRGG_ESTV0vVeDXBOKAZ3LueNoK19kprXk Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bd90ac6164a645e1829a7c53dc58f906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Tenant-Id: bd90ac6164a645e1829a7c53dc58f906 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1709519463 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Id: 2169669cc67547a18bf80a0eb08b39b0 Apr 18 18:07:43 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1709519463-project-member Apr 18 18:07:43 user devstack@n-api.service[61070]: method: > Apr 18 18:07:43 user devstack@n-api.service[61070]: exception: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: action_args: {'id': '6826dd0b-4e47-463e-8d5e-6733cf3fd087'} Apr 18 18:07:43 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. Apr 18 18:07:43 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:07:43 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] Returning 404 to user: Instance 6826dd0b-4e47-463e-8d5e-6733cf3fd087 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:07:43 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-00e0c1a9-9401-46cd-842e-29ae8e0261c3 tempest-AttachVolumeShelveTestJSON-1709519463 tempest-AttachVolumeShelveTestJSON-1709519463-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087" status: 404 len: 111 microversion: 2.20 time: 0.026610 Apr 18 18:07:43 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 143/437] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 18:07:43 2023] GET /compute/v2.1/servers/6826dd0b-4e47-463e-8d5e-6733cf3fd087 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 18:07:44 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-04f521eb-32cb-4039-83ff-78316bede8c4 req-944be447-7a56-425e-9856-a246152722b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8", "tag": "aa02f149-eeba-4e5d-bbc4-5f67142b4e60"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:07:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-04f521eb-32cb-4039-83ff-78316bede8c4 req-944be447-7a56-425e-9856-a246152722b3 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-04f521eb-32cb-4039-83ff-78316bede8c4 req-944be447-7a56-425e-9856-a246152722b3 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:44 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-04f521eb-32cb-4039-83ff-78316bede8c4 req-944be447-7a56-425e-9856-a246152722b3 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-04f521eb-32cb-4039-83ff-78316bede8c4 req-944be447-7a56-425e-9856-a246152722b3 service nova] Creating event network-changed:aa02f149-eeba-4e5d-bbc4-5f67142b4e60 for instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 on user Apr 18 18:07:44 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-04f521eb-32cb-4039-83ff-78316bede8c4 req-944be447-7a56-425e-9856-a246152722b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039048 Apr 18 18:07:44 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 149/438] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:07:46 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-add1f7d7-ccac-49f7-ac44-e165cbe9bb3d req-22dbc1d7-f789-4397-a926-d7ebb92c63ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8", "name": "network-vif-plugged", "status": "completed", "tag": "aa02f149-eeba-4e5d-bbc4-5f67142b4e60"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:07:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-add1f7d7-ccac-49f7-ac44-e165cbe9bb3d req-22dbc1d7-f789-4397-a926-d7ebb92c63ee service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-add1f7d7-ccac-49f7-ac44-e165cbe9bb3d req-22dbc1d7-f789-4397-a926-d7ebb92c63ee service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:46 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-add1f7d7-ccac-49f7-ac44-e165cbe9bb3d req-22dbc1d7-f789-4397-a926-d7ebb92c63ee service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:46 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-add1f7d7-ccac-49f7-ac44-e165cbe9bb3d req-22dbc1d7-f789-4397-a926-d7ebb92c63ee service nova] Creating event network-vif-plugged:aa02f149-eeba-4e5d-bbc4-5f67142b4e60 for instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 on user Apr 18 18:07:46 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-add1f7d7-ccac-49f7-ac44-e165cbe9bb3d req-22dbc1d7-f789-4397-a926-d7ebb92c63ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050400 Apr 18 18:07:46 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:07:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:07:48 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-70911d15-26d0-4ca2-99f9-bb4910754c08 req-78dfaae6-40a5-4c6a-9831-85214e20ec08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8", "name": "network-vif-plugged", "status": "completed", "tag": "aa02f149-eeba-4e5d-bbc4-5f67142b4e60"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:07:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-70911d15-26d0-4ca2-99f9-bb4910754c08 req-78dfaae6-40a5-4c6a-9831-85214e20ec08 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:07:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-70911d15-26d0-4ca2-99f9-bb4910754c08 req-78dfaae6-40a5-4c6a-9831-85214e20ec08 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:07:48 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-70911d15-26d0-4ca2-99f9-bb4910754c08 req-78dfaae6-40a5-4c6a-9831-85214e20ec08 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:07:48 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-70911d15-26d0-4ca2-99f9-bb4910754c08 req-78dfaae6-40a5-4c6a-9831-85214e20ec08 service nova] Creating event network-vif-plugged:aa02f149-eeba-4e5d-bbc4-5f67142b4e60 for instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 on user Apr 18 18:07:48 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-70911d15-26d0-4ca2-99f9-bb4910754c08 req-78dfaae6-40a5-4c6a-9831-85214e20ec08 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030886 Apr 18 18:07:48 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 144/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:07:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell0:SELECT=4 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:08:32 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:08:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-7d22645b-7596-43cb-86fb-174d1532f1be tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8" status: 200 len: 1546 microversion: 2.1 time: 0.469207 Apr 18 18:08:32 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 150/441] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:08:32 2023] GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 => generated 1546 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=2 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell0:SELECT=6 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=8 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:32 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:33 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-99062667-2b98-47d7-bee9-0ff64863da71 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.291793 Apr 18 18:09:33 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 18:09:32 2023] GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8/os-interface => generated 282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:09:33 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell0:SELECT=2 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:33 user devstack@n-api.service[61070]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 18:09:33 user devstack@n-api.service[61070]: Tue Apr 18 18:09:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 18 18:09:33 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:33 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=6 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=2 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:09:33 user devstack@n-api.service[61068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 18:09:33 user devstack@n-api.service[61068]: Tue Apr 18 18:09:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8/ips (ip 10.0.0.210) !!! Apr 18 18:09:33 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-9516fcb0-cba9-4475-90dd-7fa2ead452f9 req-2dada285-cad9-4cc7-a052-e496e4cde1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8", "tag": "aa02f149-eeba-4e5d-bbc4-5f67142b4e60"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:33 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:33 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-9516fcb0-cba9-4475-90dd-7fa2ead452f9 req-2dada285-cad9-4cc7-a052-e496e4cde1b5 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:33 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-9516fcb0-cba9-4475-90dd-7fa2ead452f9 req-2dada285-cad9-4cc7-a052-e496e4cde1b5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:33 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-9516fcb0-cba9-4475-90dd-7fa2ead452f9 req-2dada285-cad9-4cc7-a052-e496e4cde1b5 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-9516fcb0-cba9-4475-90dd-7fa2ead452f9 req-2dada285-cad9-4cc7-a052-e496e4cde1b5 service nova] Creating event network-changed:aa02f149-eeba-4e5d-bbc4-5f67142b4e60 for instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 on user Apr 18 18:09:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-d68e5e28-3c3b-4fe6-9380-bdc7bfe47785 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8/ips" status: 200 len: 108 microversion: 2.1 time: 0.048027 Apr 18 18:09:33 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 151/443] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 18:09:33 2023] GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8/ips => generated 108 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:09:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-9516fcb0-cba9-4475-90dd-7fa2ead452f9 req-2dada285-cad9-4cc7-a052-e496e4cde1b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118909 Apr 18 18:09:33 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 145/444] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:09:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:35 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Going to try to terminate instance {{(pid=61069) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 18:09:35 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-599975b5-ce9b-4526-9f89-e44e6b85e937 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8" status: 204 len: 0 microversion: 2.1 time: 0.126029 Apr 18 18:09:35 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 149/445] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:09:35 2023] DELETE /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:35 user devstack@n-api.service[61068]: DEBUG nova.policy [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da8052dbf914e1cb2ee508d2bb21bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26fc84542bc54be0b4ed144b4bd80820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61068) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 18:09:35 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-1da9ffd9-f09b-42ee-afeb-dfadc3d393c4 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8" status: 200 len: 1670 microversion: 2.1 time: 0.280414 Apr 18 18:09:35 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 152/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:09:35 2023] GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 => generated 1670 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 18:09:35 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [req-9e5be02c-1eb0-471e-bc3e-f3fe83daf2c0 req-2b9323cb-94db-4bd7-aa8f-d99e664f62bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8", "name": "network-vif-unplugged", "status": "completed", "tag": "aa02f149-eeba-4e5d-bbc4-5f67142b4e60"}]} {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:09:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-9e5be02c-1eb0-471e-bc3e-f3fe83daf2c0 req-2b9323cb-94db-4bd7-aa8f-d99e664f62bc service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-9e5be02c-1eb0-471e-bc3e-f3fe83daf2c0 req-2b9323cb-94db-4bd7-aa8f-d99e664f62bc service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:35 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [req-9e5be02c-1eb0-471e-bc3e-f3fe83daf2c0 req-2b9323cb-94db-4bd7-aa8f-d99e664f62bc service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:35 user devstack@n-api.service[61070]: INFO nova.api.openstack.compute.server_external_events [req-9e5be02c-1eb0-471e-bc3e-f3fe83daf2c0 req-2b9323cb-94db-4bd7-aa8f-d99e664f62bc service nova] Creating event network-vif-unplugged:aa02f149-eeba-4e5d-bbc4-5f67142b4e60 for instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 on user Apr 18 18:09:35 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [req-9e5be02c-1eb0-471e-bc3e-f3fe83daf2c0 req-2b9323cb-94db-4bd7-aa8f-d99e664f62bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115732 Apr 18 18:09:35 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 146/447] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:09:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:09:37 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [req-541bc5d4-481a-4029-bee1-2ab516a07237 req-4d3c07f7-f379-4009-983a-253446188355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8", "name": "network-vif-deleted", "tag": "aa02f149-eeba-4e5d-bbc4-5f67142b4e60"}]} {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:09:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-541bc5d4-481a-4029-bee1-2ab516a07237 req-4d3c07f7-f379-4009-983a-253446188355 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-541bc5d4-481a-4029-bee1-2ab516a07237 req-4d3c07f7-f379-4009-983a-253446188355 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:37 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [req-541bc5d4-481a-4029-bee1-2ab516a07237 req-4d3c07f7-f379-4009-983a-253446188355 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:37 user devstack@n-api.service[61069]: INFO nova.api.openstack.compute.server_external_events [req-541bc5d4-481a-4029-bee1-2ab516a07237 req-4d3c07f7-f379-4009-983a-253446188355 service nova] Creating event network-vif-deleted:aa02f149-eeba-4e5d-bbc4-5f67142b4e60 for instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 on user Apr 18 18:09:37 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [req-541bc5d4-481a-4029-bee1-2ab516a07237 req-4d3c07f7-f379-4009-983a-253446188355 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088491 Apr 18 18:09:37 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 150/448] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:09:37 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [req-810882e9-b647-407d-8c1e-2ab680d87532 req-f78043ba-cb0c-49cd-b820-a712afc4fa67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8", "name": "network-vif-plugged", "status": "completed", "tag": "aa02f149-eeba-4e5d-bbc4-5f67142b4e60"}]} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:09:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-810882e9-b647-407d-8c1e-2ab680d87532 req-f78043ba-cb0c-49cd-b820-a712afc4fa67 service nova] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:09:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-810882e9-b647-407d-8c1e-2ab680d87532 req-f78043ba-cb0c-49cd-b820-a712afc4fa67 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:09:37 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [req-810882e9-b647-407d-8c1e-2ab680d87532 req-f78043ba-cb0c-49cd-b820-a712afc4fa67 service nova] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:09:37 user devstack@n-api.service[61068]: INFO nova.api.openstack.compute.server_external_events [req-810882e9-b647-407d-8c1e-2ab680d87532 req-f78043ba-cb0c-49cd-b820-a712afc4fa67 service nova] Creating event network-vif-plugged:aa02f149-eeba-4e5d-bbc4-5f67142b4e60 for instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 on user Apr 18 18:09:37 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [req-810882e9-b647-407d-8c1e-2ab680d87532 req-f78043ba-cb0c-49cd-b820-a712afc4fa67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032672 Apr 18 18:09:37 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 153/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 18:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_api:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG dbcounter [-] [61070] Writing DB stats nova_cell1:SELECT=4 {{(pid=61070) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:25 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:10:25 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 HTTP/1.1 Apr 18 18:10:25 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:10:25 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:10:25 user devstack@n-api.service[61070]: Connection: close Apr 18 18:10:25 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:10:25 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:10:25 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:10:25 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:10:25 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:25 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:25 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:25 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:10:25 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:10:25 user devstack@n-api.service[61070]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:10:25 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:25 user devstack@n-api.service[61070]: method: > Apr 18 18:10:25 user devstack@n-api.service[61070]: exception: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:25 user devstack@n-api.service[61070]: action_args: {'id': '53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8'} Apr 18 18:10:25 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:25 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:25 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:25 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-9bf565c0-40b8-4357-8934-c2e759d8096a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8" status: 404 len: 111 microversion: 2.1 time: 0.039136 Apr 18 18:10:25 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 147/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:10:25 2023] GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:10:25 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:10:25 user devstack@n-api.service[61069]: DEBUG dbcounter [-] [61069] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61069) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:10:25 user devstack@n-api.service[61069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 18:10:25 user devstack@n-api.service[61069]: Tue Apr 18 18:10:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1830016687 (ip 10.0.0.210) !!! Apr 18 18:10:25 user devstack@n-api.service[61069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 18 18:10:25 user devstack@n-api.service[61069]: Tue Apr 18 18:10:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1830016687 (ip 10.0.0.210) !!! Apr 18 18:10:25 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-856e90e7-6861-4e6d-9bf1-4e41fb44271f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '.version_select at 0x7fb35b0af7f0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:25 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-856e90e7-6861-4e6d-9bf1-4e41fb44271f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830016687" status: 202 len: 0 microversion: 2.1 time: 0.064893 Apr 18 18:10:25 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 18:10:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830016687 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_api:SELECT=6 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG dbcounter [-] [61068] Writing DB stats nova_cell1:SELECT=12 {{(pid=61068) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:26 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:10:26 user devstack@n-api.service[61068]: request: DELETE /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 HTTP/1.1 Apr 18 18:10:26 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:10:26 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:10:26 user devstack@n-api.service[61068]: Connection: close Apr 18 18:10:26 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:10:26 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:10:26 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:10:26 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:10:26 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:26 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61068]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:26 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:10:26 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:10:26 user devstack@n-api.service[61068]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:10:26 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:26 user devstack@n-api.service[61068]: method: > Apr 18 18:10:26 user devstack@n-api.service[61068]: exception: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61068]: action_args: {'id': '53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8'} Apr 18 18:10:26 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:26 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-c1c80176-f7e8-4064-86be-40cfa4975a06 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8" status: 404 len: 111 microversion: 2.1 time: 0.036091 Apr 18 18:10:26 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 154/452] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:10:26 2023] DELETE /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:26 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:10:26 user devstack@n-api.service[61070]: request: GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 HTTP/1.1 Apr 18 18:10:26 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:10:26 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:10:26 user devstack@n-api.service[61070]: Connection: close Apr 18 18:10:26 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:10:26 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:10:26 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:10:26 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:10:26 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:26 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:26 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:10:26 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:10:26 user devstack@n-api.service[61070]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:10:26 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:26 user devstack@n-api.service[61070]: method: > Apr 18 18:10:26 user devstack@n-api.service[61070]: exception: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61070]: action_args: {'id': '53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8'} Apr 18 18:10:26 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance 53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:26 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-c03ee9b8-410b-4eb2-8981-cf49e21b6a0a tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8" status: 404 len: 111 microversion: 2.1 time: 0.026863 Apr 18 18:10:26 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 148/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:10:26 2023] GET /compute/v2.1/servers/53dc81c9-cf77-4b0b-9b90-b9ceb7ea47e8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:26 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:10:26 user devstack@n-api.service[61069]: request: DELETE /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 HTTP/1.1 Apr 18 18:10:26 user devstack@n-api.service[61069]: Accept: application/json Apr 18 18:10:26 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 18:10:26 user devstack@n-api.service[61069]: Connection: close Apr 18 18:10:26 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 18:10:26 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 18:10:26 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 18:10:26 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 18:10:26 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:26 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:26 user devstack@n-api.service[61069]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:26 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 18:10:26 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 18:10:26 user devstack@n-api.service[61069]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:10:26 user devstack@n-api.service[61069]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:26 user devstack@n-api.service[61069]: method: > Apr 18 18:10:26 user devstack@n-api.service[61069]: exception: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61069]: action_args: {'id': '724f06ff-e920-44ff-86e4-073fc26e0913'} Apr 18 18:10:26 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:26 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:26 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:26 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-ab71dfd0-05de-47fe-9684-536b4aac093d tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913" status: 404 len: 111 microversion: 2.1 time: 0.031626 Apr 18 18:10:26 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 152/454] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:10:26 2023] DELETE /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG nova.compute.api [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: 724f06ff-e920-44ff-86e4-073fc26e0913] Fetching instance by UUID {{(pid=61068) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG oslo_concurrency.lockutils [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61068) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:27 user devstack@n-api.service[61068]: INFO nova.api.openstack.wsgi [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:10:27 user devstack@n-api.service[61068]: request: GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 HTTP/1.1 Apr 18 18:10:27 user devstack@n-api.service[61068]: Accept: application/json Apr 18 18:10:27 user devstack@n-api.service[61068]: Accept-Encoding: identity Apr 18 18:10:27 user devstack@n-api.service[61068]: Connection: close Apr 18 18:10:27 user devstack@n-api.service[61068]: Content-Length: 0 Apr 18 18:10:27 user devstack@n-api.service[61068]: Content-Type: application/json Apr 18 18:10:27 user devstack@n-api.service[61068]: Host: 10.0.0.210 Apr 18 18:10:27 user devstack@n-api.service[61068]: Openstack-System-Scope: None Apr 18 18:10:27 user devstack@n-api.service[61068]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Domain-Id: None Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Domain-Name: None Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Identity-Status: Confirmed Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Is-Admin-Project: True Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Project-Domain-Id: default Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Project-Domain-Name: Default Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Role: member,reader Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Roles: member,reader Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:27 user devstack@n-api.service[61068]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61068]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:27 user devstack@n-api.service[61068]: X-User-Domain-Id: default Apr 18 18:10:27 user devstack@n-api.service[61068]: X-User-Domain-Name: Default Apr 18 18:10:27 user devstack@n-api.service[61068]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:10:27 user devstack@n-api.service[61068]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:27 user devstack@n-api.service[61068]: method: > Apr 18 18:10:27 user devstack@n-api.service[61068]: exception: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:27 user devstack@n-api.service[61068]: action_args: {'id': '724f06ff-e920-44ff-86e4-073fc26e0913'} Apr 18 18:10:27 user devstack@n-api.service[61068]: {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. Apr 18 18:10:27 user devstack@n-api.service[61068]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance 724f06ff-e920-44ff-86e4-073fc26e0913 could not be found. {{(pid=61068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:27 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-8693f6aa-8414-49d9-8bc9-ce8b83c6edc5 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913" status: 404 len: 111 microversion: 2.1 time: 0.036200 Apr 18 18:10:27 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 155/455] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:10:26 2023] GET /compute/v2.1/servers/724f06ff-e920-44ff-86e4-073fc26e0913 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG nova.compute.api [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61070) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG oslo_concurrency.lockutils [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61070) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:27 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:10:27 user devstack@n-api.service[61070]: request: DELETE /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c HTTP/1.1 Apr 18 18:10:27 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:10:27 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:10:27 user devstack@n-api.service[61070]: Connection: close Apr 18 18:10:27 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:10:27 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:10:27 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:10:27 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:10:27 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:27 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61070]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:27 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:10:27 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:10:27 user devstack@n-api.service[61070]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:10:27 user devstack@n-api.service[61070]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:27 user devstack@n-api.service[61070]: method: > Apr 18 18:10:27 user devstack@n-api.service[61070]: exception: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61070]: action_args: {'id': 'f03edc06-3774-4d88-82f8-f9f83e82230c'} Apr 18 18:10:27 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:27 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-b8f2629b-dd7f-4d38-b5ed-df27f0cd8f19 tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c" status: 404 len: 111 microversion: 2.1 time: 0.026884 Apr 18 18:10:27 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 149/456] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 18:10:27 2023] DELETE /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Calling method '>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG nova.compute.api [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] [instance: f03edc06-3774-4d88-82f8-f9f83e82230c] Fetching instance by UUID {{(pid=61069) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Acquiring lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG oslo_concurrency.lockutils [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Lock "9d27f925-8bed-44bf-a25d-45ceb80a7926" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61069) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 18:10:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.wsgi [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] HTTP exception thrown: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Request method failure captured: Apr 18 18:10:27 user devstack@n-api.service[61069]: request: GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c HTTP/1.1 Apr 18 18:10:27 user devstack@n-api.service[61069]: Accept: application/json Apr 18 18:10:27 user devstack@n-api.service[61069]: Accept-Encoding: identity Apr 18 18:10:27 user devstack@n-api.service[61069]: Connection: close Apr 18 18:10:27 user devstack@n-api.service[61069]: Content-Length: 0 Apr 18 18:10:27 user devstack@n-api.service[61069]: Content-Type: application/json Apr 18 18:10:27 user devstack@n-api.service[61069]: Host: 10.0.0.210 Apr 18 18:10:27 user devstack@n-api.service[61069]: Openstack-System-Scope: None Apr 18 18:10:27 user devstack@n-api.service[61069]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Auth-Token: gAAAAABkPtscVLk-t2xgIF4PvI0ktkSudNwqHlRyMbtXgfnXtoqQXVppUHhdSRUdADPSUWIBMZnHOQHwjS7sDrf5oGlpG12WJq27Up2RUfFQ2Ql8KhxHt1-4oTCVob761k0zkiSd-_TQL1IZmVE23RfCD4PotJaZGCsSUJKEXNnCTP5RHv4VM6Y Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Domain-Id: None Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Domain-Name: None Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Identity-Status: Confirmed Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Is-Admin-Project: True Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Project-Domain-Id: default Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Project-Domain-Name: Default Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Project-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Project-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Role: member,reader Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Roles: member,reader Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/26fc84542bc54be0b4ed144b4bd80820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Tenant: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Tenant-Id: 26fc84542bc54be0b4ed144b4bd80820 Apr 18 18:10:27 user devstack@n-api.service[61069]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1338292293 Apr 18 18:10:27 user devstack@n-api.service[61069]: X-User: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:27 user devstack@n-api.service[61069]: X-User-Domain-Id: default Apr 18 18:10:27 user devstack@n-api.service[61069]: X-User-Domain-Name: Default Apr 18 18:10:27 user devstack@n-api.service[61069]: X-User-Id: 3da8052dbf914e1cb2ee508d2bb21bd7 Apr 18 18:10:27 user devstack@n-api.service[61069]: X-User-Name: tempest-AttachVolumeNegativeTest-1338292293-project-member Apr 18 18:10:27 user devstack@n-api.service[61069]: method: > Apr 18 18:10:27 user devstack@n-api.service[61069]: exception: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61069]: action_args: {'id': 'f03edc06-3774-4d88-82f8-f9f83e82230c'} Apr 18 18:10:27 user devstack@n-api.service[61069]: {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. Apr 18 18:10:27 user devstack@n-api.service[61069]: ERROR nova.api.openstack.wsgi Apr 18 18:10:27 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] Returning 404 to user: Instance f03edc06-3774-4d88-82f8-f9f83e82230c could not be found. {{(pid=61069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:27 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-bd1f0736-ab08-4a12-a50f-aa252b4d7a9f tempest-AttachVolumeNegativeTest-1338292293 tempest-AttachVolumeNegativeTest-1338292293-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c" status: 404 len: 111 microversion: 2.1 time: 0.027135 Apr 18 18:10:27 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 153/457] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 18:10:27 2023] GET /compute/v2.1/servers/f03edc06-3774-4d88-82f8-f9f83e82230c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 18:10:31 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-4d750f69-951d-4df6-b7cd-17319dc179e1 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] Action: 'create', calling method: .version_select at 0x7fb35b1e1480>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1680842878", "metadata": {"Type": "work"}}} {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 18:10:32 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-4d750f69-951d-4df6-b7cd-17319dc179e1 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.529259 Apr 18 18:10:32 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 156/458] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 18:10:31 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 531 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 18:10:32 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-edfeaf30-b28b-4131-8214-701e1b8f7924 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] Calling method '.version_select at 0x7fb35b264700>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:32 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-edfeaf30-b28b-4131-8214-701e1b8f7924 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0" status: 200 len: 350 microversion: 2.1 time: 0.197779 Apr 18 18:10:32 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 150/459] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 18:10:32 2023] GET /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0 => generated 350 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:10:33 user devstack@n-api.service[61069]: DEBUG nova.api.openstack.wsgi [None req-ee43e030-6a01-45d5-90f2-7d527d1d498b tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] Calling method '.version_select at 0x7fb35b0aeef0>' {{(pid=61069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:33 user devstack@n-api.service[61069]: INFO nova.api.openstack.requestlog [None req-ee43e030-6a01-45d5-90f2-7d527d1d498b tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0" status: 200 len: 350 microversion: 2.1 time: 0.067906 Apr 18 18:10:33 user devstack@n-api.service[61069]: [pid: 61069|app: 0|req: 154/460] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 18:10:33 2023] GET /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 18:10:33 user devstack@n-api.service[61068]: DEBUG nova.api.openstack.wsgi [None req-747ee8c9-282d-4ad6-9966-a8e5c5e207d4 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] Calling method '.version_select at 0x7fb35af25d80>' {{(pid=61068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:33 user devstack@n-api.service[61068]: INFO nova.api.openstack.requestlog [None req-747ee8c9-282d-4ad6-9966-a8e5c5e207d4 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0" status: 202 len: 0 microversion: 2.1 time: 0.193631 Apr 18 18:10:33 user devstack@n-api.service[61068]: [pid: 61068|app: 0|req: 157/461] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 18:10:33 2023] DELETE /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 18:10:33 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-0e7ae148-b359-4fee-8fb1-868ebf3b3b56 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] Calling method '.version_select at 0x7fb35b267400>' {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 18:10:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.wsgi [None req-0e7ae148-b359-4fee-8fb1-868ebf3b3b56 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] HTTP exception thrown: Volume d79b40cd-6678-4214-bc78-f9df6392e3c0 could not be found. Apr 18 18:10:33 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-0e7ae148-b359-4fee-8fb1-868ebf3b3b56 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] Request method failure captured: Apr 18 18:10:33 user devstack@n-api.service[61070]: request: GET /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0 HTTP/1.1 Apr 18 18:10:33 user devstack@n-api.service[61070]: Accept: application/json Apr 18 18:10:33 user devstack@n-api.service[61070]: Accept-Encoding: identity Apr 18 18:10:33 user devstack@n-api.service[61070]: Connection: close Apr 18 18:10:33 user devstack@n-api.service[61070]: Content-Length: 0 Apr 18 18:10:33 user devstack@n-api.service[61070]: Content-Type: application/json Apr 18 18:10:33 user devstack@n-api.service[61070]: Host: 10.0.0.210 Apr 18 18:10:33 user devstack@n-api.service[61070]: Openstack-System-Scope: None Apr 18 18:10:33 user devstack@n-api.service[61070]: User-Agent: python-urllib3/1.26.15 Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Auth-Token: gAAAAABkPt0Xn25G0z5BGosNwmvDIQJsb-GLiTkDarKoSfsm9t2C6sJWbOWNKFacsjTaFCjbuJmvdkMLTPD6MpuLRAV8NFwjF668z91cvJ6wYIU_nQ1IxunYEDmzS5mYf5Q8ZbJNUy6yfG74hZBxG0oadUUJkfqWD5g3yLcIo5gxjP3cTBFxzvY Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Domain-Id: None Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Domain-Name: None Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Identity-Status: Confirmed Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Is-Admin-Project: True Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Project-Domain-Id: default Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Project-Domain-Name: Default Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Project-Id: 9cd0ab98217b47df9f24ba0547e2b805 Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Project-Name: tempest-VolumesGetTestJSON-953411695 Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Role: member,reader Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Roles: member,reader Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9cd0ab98217b47df9f24ba0547e2b805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9cd0ab98217b47df9f24ba0547e2b805"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9cd0ab98217b47df9f24ba0547e2b805"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Tenant: tempest-VolumesGetTestJSON-953411695 Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Tenant-Id: 9cd0ab98217b47df9f24ba0547e2b805 Apr 18 18:10:33 user devstack@n-api.service[61070]: X-Tenant-Name: tempest-VolumesGetTestJSON-953411695 Apr 18 18:10:33 user devstack@n-api.service[61070]: X-User: tempest-VolumesGetTestJSON-953411695-project-member Apr 18 18:10:33 user devstack@n-api.service[61070]: X-User-Domain-Id: default Apr 18 18:10:33 user devstack@n-api.service[61070]: X-User-Domain-Name: Default Apr 18 18:10:33 user devstack@n-api.service[61070]: X-User-Id: 8a28f88b0c7a4774b4e28afd9badc694 Apr 18 18:10:33 user devstack@n-api.service[61070]: X-User-Name: tempest-VolumesGetTestJSON-953411695-project-member Apr 18 18:10:33 user devstack@n-api.service[61070]: method: Apr 18 18:10:33 user devstack@n-api.service[61070]: exception: Volume d79b40cd-6678-4214-bc78-f9df6392e3c0 could not be found. Apr 18 18:10:33 user devstack@n-api.service[61070]: action_args: {'id': 'd79b40cd-6678-4214-bc78-f9df6392e3c0'} Apr 18 18:10:33 user devstack@n-api.service[61070]: {{(pid=61070) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d79b40cd-6678-4214-bc78-f9df6392e3c0 could not be found. (HTTP 404) (Request-ID: req-fb7aea4e-6914-4f81-9882-8ffa7c8796ae) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d79b40cd-6678-4214-bc78-f9df6392e3c0 could not be found. Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d79b40cd-6678-4214-bc78-f9df6392e3c0 could not be found. Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d79b40cd-6678-4214-bc78-f9df6392e3c0 could not be found. Apr 18 18:10:33 user devstack@n-api.service[61070]: ERROR nova.api.openstack.wsgi Apr 18 18:10:33 user devstack@n-api.service[61070]: DEBUG nova.api.openstack.wsgi [None req-0e7ae148-b359-4fee-8fb1-868ebf3b3b56 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] Returning 404 to user: Volume d79b40cd-6678-4214-bc78-f9df6392e3c0 could not be found. {{(pid=61070) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 18:10:33 user devstack@n-api.service[61070]: INFO nova.api.openstack.requestlog [None req-0e7ae148-b359-4fee-8fb1-868ebf3b3b56 tempest-VolumesGetTestJSON-953411695 tempest-VolumesGetTestJSON-953411695-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0" status: 404 len: 109 microversion: 2.1 time: 0.036290 Apr 18 18:10:33 user devstack@n-api.service[61070]: [pid: 61070|app: 0|req: 151/462] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 18:10:33 2023] GET /compute/v2.1/os-volumes/d79b40cd-6678-4214-bc78-f9df6392e3c0 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)