Apr 20 10:21:58 user devstack@n-api.service[61646]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 10:21:58 user devstack@n-api.service[61646]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 20 10:21:58 2023] *** Apr 20 10:21:58 user devstack@n-api.service[61646]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 20 10:21:58 user devstack@n-api.service[61646]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 20 10:21:58 user devstack@n-api.service[61646]: nodename: user Apr 20 10:21:58 user devstack@n-api.service[61646]: machine: x86_64 Apr 20 10:21:58 user devstack@n-api.service[61646]: clock source: unix Apr 20 10:21:58 user devstack@n-api.service[61646]: pcre jit disabled Apr 20 10:21:58 user devstack@n-api.service[61646]: detected number of CPU cores: 12 Apr 20 10:21:58 user devstack@n-api.service[61646]: current working directory: / Apr 20 10:21:58 user devstack@n-api.service[61646]: detected binary path: /usr/bin/uwsgi-core Apr 20 10:21:58 user devstack@n-api.service[61646]: your processes number limit is 63637 Apr 20 10:21:58 user devstack@n-api.service[61646]: your memory page size is 4096 bytes Apr 20 10:21:58 user devstack@n-api.service[61646]: detected max file descriptor number: 2048 Apr 20 10:21:58 user devstack@n-api.service[61646]: lock engine: pthread robust mutexes Apr 20 10:21:58 user devstack@n-api.service[61646]: thunder lock: enabled Apr 20 10:21:58 user devstack@n-api.service[61646]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 10:21:58 user devstack@n-api.service[61646]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 20 10:21:58 user devstack@n-api.service[61646]: Python main interpreter initialized at 0x55ed50dad990 Apr 20 10:21:58 user devstack@n-api.service[61646]: python threads support enabled Apr 20 10:21:58 user devstack@n-api.service[61646]: your server socket listen backlog is limited to 100 connections Apr 20 10:21:58 user devstack@n-api.service[61646]: your mercy for graceful operations on workers is 90 seconds Apr 20 10:21:58 user devstack@n-api.service[61646]: mapped 537436 bytes (524 KB) for 3 cores Apr 20 10:21:58 user devstack@n-api.service[61646]: *** Operational MODE: preforking *** Apr 20 10:21:58 user devstack@n-api.service[61646]: *** uWSGI is running in multiple interpreter mode *** Apr 20 10:21:58 user devstack@n-api.service[61646]: spawned uWSGI master process (pid: 61646) Apr 20 10:21:58 user devstack@n-api.service[61646]: spawned uWSGI worker 1 (pid: 61647, cores: 1) Apr 20 10:21:58 user devstack@n-api.service[61646]: spawned uWSGI worker 2 (pid: 61648, cores: 1) Apr 20 10:21:58 user devstack@n-api.service[61646]: spawned uWSGI worker 3 (pid: 61649, cores: 1) Apr 20 10:21:58 user devstack@n-api.service[61646]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 10:21:59 user devstack@n-api.service[61649]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 10:21:59 user devstack@n-api.service[61648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 10:21:59 user devstack@n-api.service[61647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 10:22:02 user devstack@n-api.service[61649]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 10:22:02 user devstack@n-api.service[61649]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 10:22:02 user devstack@n-api.service[61649]: and ``live_migration_inbound_addr`` respectively. Apr 20 10:22:02 user devstack@n-api.service[61649]: ). Its value may be silently ignored in the future. Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 10:22:02 user devstack@n-api.service[61647]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 10:22:02 user devstack@n-api.service[61647]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 10:22:02 user devstack@n-api.service[61647]: and ``live_migration_inbound_addr`` respectively. Apr 20 10:22:02 user devstack@n-api.service[61647]: ). Its value may be silently ignored in the future. Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 10:22:02 user devstack@n-api.service[61648]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 10:22:02 user devstack@n-api.service[61648]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 10:22:02 user devstack@n-api.service[61648]: and ``live_migration_inbound_addr`` respectively. Apr 20 10:22:02 user devstack@n-api.service[61648]: ). Its value may be silently ignored in the future. Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61649) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61647) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 10:22:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61648) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 10:22:02 user devstack@n-api.service[61649]: INFO dbcounter [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Registered counter for database nova_api Apr 20 10:22:02 user devstack@n-api.service[61647]: INFO dbcounter [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Registered counter for database nova_api Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_db.sqlalchemy.engines [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61649) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writer thread running {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61647) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writer thread running {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG nova.context [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f21b7af8-f4f6-43eb-856a-0fb219d1bf22(cell1) {{(pid=61649) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:22:02 user devstack@n-api.service[61648]: INFO dbcounter [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Registered counter for database nova_api Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG nova.context [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f21b7af8-f4f6-43eb-856a-0fb219d1bf22(cell1) {{(pid=61647) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:22:02 user devstack@n-api.service[61649]: INFO dbcounter [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Registered counter for database nova_cell0 Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:22:02 user devstack@n-api.service[61649]: INFO dbcounter [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Registered counter for database nova_cell1 Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:22:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:22:02 user devstack@n-api.service[61647]: INFO dbcounter [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Registered counter for database nova_cell0 Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_db.sqlalchemy.engines [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61649) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:02 user devstack@n-api.service[61649]: DEBUG oslo_db.sqlalchemy.engines [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61649) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:02 user devstack@n-api.service[61647]: INFO dbcounter [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Registered counter for database nova_cell1 Apr 20 10:22:03 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writer thread running {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61647]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61647) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writer thread running {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61647]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61647) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_db.sqlalchemy.engines [None req-f033653e-b15b-47f9-950b-681245124c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61648) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writer thread running {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG nova.context [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f21b7af8-f4f6-43eb-856a-0fb219d1bf22(cell1) {{(pid=61648) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:22:03 user devstack@n-api.service[61648]: INFO dbcounter [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Registered counter for database nova_cell0 Apr 20 10:22:03 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writer thread running {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61648]: INFO dbcounter [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Registered counter for database nova_cell1 Apr 20 10:22:03 user devstack@n-api.service[61649]: INFO dbcounter [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Registered counter for database nova_cell0 Apr 20 10:22:03 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writer thread running {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_db.sqlalchemy.engines [None req-f033653e-b15b-47f9-950b-681245124c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61648) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writer thread running {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_db.sqlalchemy.engines [None req-f033653e-b15b-47f9-950b-681245124c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61648) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61647]: INFO dbcounter [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Registered counter for database nova_cell0 Apr 20 10:22:03 user devstack@n-api.service[61649]: DEBUG oslo_db.sqlalchemy.engines [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61649) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writer thread running {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61647]: DEBUG oslo_db.sqlalchemy.engines [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61647) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writer thread running {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writer thread running {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61648]: INFO dbcounter [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Registered counter for database nova_cell0 Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG oslo_db.sqlalchemy.engines [None req-f033653e-b15b-47f9-950b-681245124c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61648) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 10:22:03 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writer thread running {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 10:22:03 user devstack@n-api.service[61649]: WARNING keystonemiddleware.auth_token [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 10:22:03 user devstack@n-api.service[61648]: WARNING keystonemiddleware.auth_token [None req-f033653e-b15b-47f9-950b-681245124c0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 10:22:03 user devstack@n-api.service[61649]: WARNING keystonemiddleware.auth_token [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 10:22:03 user devstack@n-api.service[61648]: WARNING keystonemiddleware.auth_token [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 10:22:03 user devstack@n-api.service[61647]: WARNING keystonemiddleware.auth_token [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 10:22:03 user devstack@n-api.service[61647]: WARNING keystonemiddleware.auth_token [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 10:22:03 user devstack@n-api.service[61649]: WARNING keystonemiddleware.auth_token [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 10:22:03 user devstack@n-api.service[61649]: WARNING keystonemiddleware.auth_token [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 10:22:03 user devstack@n-api.service[61649]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed50dad990 pid: 61649 (default app) Apr 20 10:22:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:22:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001885 Apr 20 10:22:03 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 20 10:22:03 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:22:03 user devstack@n-api.service[61647]: WARNING keystonemiddleware.auth_token [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 10:22:03 user devstack@n-api.service[61647]: WARNING keystonemiddleware.auth_token [None req-f5cfa27a-1010-44fe-8bb1-031d1f1ecf80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 10:22:03 user devstack@n-api.service[61647]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ed50dad990 pid: 61647 (default app) Apr 20 10:22:04 user devstack@n-api.service[61648]: WARNING keystonemiddleware.auth_token [None req-f033653e-b15b-47f9-950b-681245124c0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 10:22:04 user devstack@n-api.service[61648]: WARNING keystonemiddleware.auth_token [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 10:22:04 user devstack@n-api.service[61648]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ed50dad990 pid: 61648 (default app) Apr 20 10:24:10 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f85d238e-8f05-4f39-a190-23213731f4dc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001562 Apr 20 10:24:10 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:10 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:10 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:10 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:10 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:10 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:10 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-67fd3e15-223a-4db0-8de4-60e424110688 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:10 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-67fd3e15-223a-4db0-8de4-60e424110688 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444950 Apr 20 10:24:10 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 10:24:10 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:13 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f033653e-b15b-47f9-950b-681245124c0a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002117 Apr 20 10:24:13 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:13 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:13 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-b6d4f402-6d41-45ee-aeb3-6caa1b7fe027 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "name": "cirros256"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-b6d4f402-6d41-45ee-aeb3-6caa1b7fe027 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.324433 Apr 20 10:24:13 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:13 2023] POST /compute/v2.1/flavors => generated 405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-e632a10b-ab92-4ce0-8380-b551a8c3f816 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-e632a10b-ab92-4ce0-8380-b551a8c3f816 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058277 Apr 20 10:24:13 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 10:24:13 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:15 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:15 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f033653e-b15b-47f9-950b-681245124c0a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001495 Apr 20 10:24:15 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:15 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-1ccfe683-d83e-40c0-b654-779b20b47ea9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "ram": 512, "swap": 0}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-1ccfe683-d83e-40c0-b654-779b20b47ea9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083920 Apr 20 10:24:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:15 2023] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:15 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-83de8019-2325-4d5d-9d37-21cd539a5bf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:15 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-83de8019-2325-4d5d-9d37-21cd539a5bf1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041686 Apr 20 10:24:15 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 10:24:15 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:17 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:17 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f033653e-b15b-47f9-950b-681245124c0a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001514 Apr 20 10:24:17 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:17 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-9d70726f-d71b-48f1-8270-5004a77f4254 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "ds1G", "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:17 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-9d70726f-d71b-48f1-8270-5004a77f4254 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061320 Apr 20 10:24:17 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:17 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:17 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-3e6da842-1b63-432f-8f83-0508766cca73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:17 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-3e6da842-1b63-432f-8f83-0508766cca73 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029064 Apr 20 10:24:17 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 10:24:17 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 10:24:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:19 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f033653e-b15b-47f9-950b-681245124c0a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001554 Apr 20 10:24:19 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:19 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:19 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-1fc9692b-ed52-42cf-b8e5-7b3764de9ec6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:19 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-1fc9692b-ed52-42cf-b8e5-7b3764de9ec6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.077073 Apr 20 10:24:19 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:19 2023] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-e1fea04e-64ff-42e9-a667-bdb921e2be5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-e1fea04e-64ff-42e9-a667-bdb921e2be5b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025310 Apr 20 10:24:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 10:24:19 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:21 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:21 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f033653e-b15b-47f9-950b-681245124c0a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001477 Apr 20 10:24:21 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:21 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-73e71ac5-4052-476b-afa4-fbd2b940e022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:21 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-73e71ac5-4052-476b-afa4-fbd2b940e022 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.057885 Apr 20 10:24:21 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:21 2023] POST /compute/v2.1/flavors => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:21 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024815 Apr 20 10:24:21 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 10:24:21 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:23 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f033653e-b15b-47f9-950b-681245124c0a None None] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:23 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f033653e-b15b-47f9-950b-681245124c0a None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001502 Apr 20 10:24:23 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:23 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:23 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-72685f6b-ec7f-4222-952c-014af52f0e08 admin admin] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:23 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-72685f6b-ec7f-4222-952c-014af52f0e08 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.069930 Apr 20 10:24:23 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 10:24:23 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:24:25 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:25 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002822 Apr 20 10:24:25 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:25 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:25 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:25 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:25 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:25 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:24:25 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-3701a635-bbdd-4118-b7be-268947fe41f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "vcpus": 1}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:25 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-3701a635-bbdd-4118-b7be-268947fe41f4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.342980 Apr 20 10:24:25 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:25 2023] POST /compute/v2.1/flavors => generated 400 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:25 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-c688e0a3-3db2-4dd4-8d59-49d778cf9fdc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:25 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-c688e0a3-3db2-4dd4-8d59-49d778cf9fdc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089600 Apr 20 10:24:25 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 10:24:25 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:27 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:27 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001624 Apr 20 10:24:27 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:27 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-16f71d25-7280-4575-9a48-53d363475165 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:27 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-16f71d25-7280-4575-9a48-53d363475165 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.057157 Apr 20 10:24:27 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:27 2023] POST /compute/v2.1/flavors => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:27 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-67f6b30e-cb55-46c1-8330-893475f3e694 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:27 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-67f6b30e-cb55-46c1-8330-893475f3e694 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035077 Apr 20 10:24:27 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 10:24:27 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:29 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:29 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001612 Apr 20 10:24:29 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:29 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-8eb0a6fe-d7b5-409a-bd20-f8639c6a8500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:29 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-8eb0a6fe-d7b5-409a-bd20-f8639c6a8500 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.058204 Apr 20 10:24:29 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:29 2023] POST /compute/v2.1/flavors => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:29 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-c2f2eb5d-376b-4bd4-9cbd-4e440feee841 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:29 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-c2f2eb5d-376b-4bd4-9cbd-4e440feee841 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025480 Apr 20 10:24:29 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 10:24:29 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:31 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:31 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001624 Apr 20 10:24:31 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:31 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:31 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-1f92571e-3d96-4b9f-b5d9-c8a923330200 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:31 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-1f92571e-3d96-4b9f-b5d9-c8a923330200 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.091664 Apr 20 10:24:31 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:31 2023] POST /compute/v2.1/flavors => generated 403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:31 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-2a8db377-efb8-4b89-827d-0fdc16cb4641 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:31 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-2a8db377-efb8-4b89-827d-0fdc16cb4641 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024614 Apr 20 10:24:31 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 10:24:31 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:24:33 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:24:33 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002206 Apr 20 10:24:33 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 10:24:33 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:24:33 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-92ac5d1c-1cc1-4569-b01d-8efe5d7fc491 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:33 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-92ac5d1c-1cc1-4569-b01d-8efe5d7fc491 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.062972 Apr 20 10:24:33 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 10:24:33 2023] POST /compute/v2.1/flavors => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:24:33 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-df7ea1bb-3025-4abc-8c65-e74886575672 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:24:33 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-df7ea1bb-3025-4abc-8c65-e74886575672 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025248 Apr 20 10:24:33 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 10:24:33 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:25:04 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:25:04 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-86d1e80a-6a86-4c0f-9c4d-23eeb13e9dd7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001751 Apr 20 10:25:04 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 10:25:04 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:25:04 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:25:05 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.100604 Apr 20 10:25:05 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 20 10:25:04 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:25:37 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-df7ea1bb-3025-4abc-8c65-e74886575672 admin admin] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:25:37 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-df7ea1bb-3025-4abc-8c65-e74886575672 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001938 Apr 20 10:25:37 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 10:25:37 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:25:37 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:25:37 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-f67a1933-5ec8-4d8f-bdcd-7a15be7ba8d8 admin admin] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:25:37 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-f67a1933-5ec8-4d8f-bdcd-7a15be7ba8d8 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.084682 Apr 20 10:25:37 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 20 10:25:37 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:25:41 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:25:41 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001589 Apr 20 10:25:41 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 10:25:41 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:25:41 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:25:41 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e1cc78c3-5959-4555-b7bf-d0683438f24c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "42", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.nano", "ram": 128, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:25:41 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e1cc78c3-5959-4555-b7bf-d0683438f24c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.072157 Apr 20 10:25:41 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 10:25:41 2023] POST /compute/v2.1/flavors => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:25:41 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-fd48b6d7-1e4e-44c2-a04f-6b97344db0d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:25:41 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-fd48b6d7-1e4e-44c2-a04f-6b97344db0d3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024692 Apr 20 10:25:41 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 10:25:41 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:25:45 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:25:45 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-94eed7fb-c297-44ff-8bf8-56db4bebe7b7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002423 Apr 20 10:25:45 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 10:25:45 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:25:45 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-31064cb3-bec6-4cf8-b3a9-0c78d291eafd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.micro", "id": "84", "ram": 192, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:25:45 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-31064cb3-bec6-4cf8-b3a9-0c78d291eafd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071138 Apr 20 10:25:45 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 10:25:45 2023] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:25:45 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-276dbeb8-744f-4d9f-a1bb-5c6db67dd51b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:25:45 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-276dbeb8-744f-4d9f-a1bb-5c6db67dd51b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025122 Apr 20 10:25:45 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 10:25:45 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:28:17 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:17 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:17 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:17 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-fd61e4fc-e671-4aa5-8ae2-0a3e67be5a28 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Action: 'create', calling method: .version_select at 0x7f122b3fd3f0>, body: {"keypair": {"name": "tempest-keypair-2096466478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAh9xOp+18xwLGeRalB9BZJ/w8VTQdLWJWLt/GaIgucfc2qbhwsBZgwV0eAZLo1CJ17o1m08+BmrJtQvN99qzggaLadMbVfpQ2nwEGkvh5hKNizDvlBcY5GFmW0Xmz1BQ=="}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:17 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-fd61e4fc-e671-4aa5-8ae2-0a3e67be5a28 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for project 1b4a2af680394ec889b4661753658b01. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:17 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-fd61e4fc-e671-4aa5-8ae2-0a3e67be5a28 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for user 67955d2e81c04b8d8dbcbe577303e025 and project 1b4a2af680394ec889b4661753658b01. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:17 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-fd61e4fc-e671-4aa5-8ae2-0a3e67be5a28 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.241814 Apr 20 10:28:17 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:28:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:18 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:18 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-294793328", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "bd16afd3-655a-4681-9793-21eff7495aee"}]}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:19 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-2c045502-5077-4e93-86d4-b61b2b9117f2 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Action: 'create', calling method: .version_select at 0x7f122b4cbb50>, body: {"keypair": {"name": "tempest-keypair-314135284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPer3atuApOKAbOrxgU77C03uvd3ClFPy3FRncu+A4hBfn7+Ligr5c8zlC1kkZihqe2/A/t/d8AFp1mDAF+J+oDrvVOTMmcabgcsFyIy7gKcmM4pBHM2RndymuOvmh30Q=="}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:19 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-2c045502-5077-4e93-86d4-b61b2b9117f2 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Getting quotas for project 2d1545b79af0497497e960cbd68aa8f2. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:19 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-2c045502-5077-4e93-86d4-b61b2b9117f2 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Getting quotas for user 2aef9efd33b946709d8f01f41b79f382 and project 2d1545b79af0497497e960cbd68aa8f2. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-2c045502-5077-4e93-86d4-b61b2b9117f2 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.233801 Apr 20 10:28:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 16/47] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:28:19 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:19 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] validate_networks() for [('bd16afd3-655a-4681-9793-21eff7495aee', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Getting quotas for project f986df042c594f71a4db3da582def690. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Getting quotas for user 25f64a72e9ec4ad599a5c63bec4d092e and project f986df042c594f71a4db3da582def690. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:28:20 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] [instance: cf494c03-d188-49c7-879e-29d2fa555549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:28:20 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f896f2b7-ea25-4649-8248-254cdf0ac136 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.921881 Apr 20 10:28:20 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 17/48] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:28:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:28:20 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-f336b418-7e9b-4557-9de4-f48638d56471 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:28:20 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-f336b418-7e9b-4557-9de4-f48638d56471 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] [instance: cf494c03-d188-49c7-879e-29d2fa555549] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:28:20 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-b65fa6b9-3fac-4eb6-bc8e-30e0d7857899 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Action: 'create', calling method: .version_select at 0x7f122b27e0e0>, body: {"keypair": {"name": "tempest-keypair-748576161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHK0F1a8yp8Xvld+jR/l8lxpwDFkBJKvOkeodCIMdNIsy3rZb2cz1b4Lbds32NZ3fZXZBlAND7bKaMCernVFVPVOsJFwYkZamLCbeIJtO4ahR/NTi6fJvZoUyyvCYQG3g=="}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:20 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-b65fa6b9-3fac-4eb6-bc8e-30e0d7857899 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Getting quotas for project 8d9c5dd66fd0496a8e92b41d98fe1727. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:20 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-b65fa6b9-3fac-4eb6-bc8e-30e0d7857899 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Getting quotas for user bc5470a076e14c218cf04fad713ce074 and project 8d9c5dd66fd0496a8e92b41d98fe1727. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:20 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-b65fa6b9-3fac-4eb6-bc8e-30e0d7857899 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181169 Apr 20 10:28:20 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 16/49] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:28:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:20 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-f336b418-7e9b-4557-9de4-f48638d56471 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f64a72e9ec4ad599a5c63bec4d092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f986df042c594f71a4db3da582def690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:28:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-f336b418-7e9b-4557-9de4-f48638d56471 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549" status: 200 len: 1208 microversion: 2.1 time: 0.303560 Apr 20 10:28:21 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:28:20 2023] GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549 => generated 1208 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:28:24 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1817883104", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "06131689-128d-43da-b721-a9dda3f2e19f"}], "security_groups": [{"name": "tempest-securitygroup--1045725567"}], "key_name": "tempest-keypair-314135284", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:24 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] validate_networks() for [('06131689-128d-43da-b721-a9dda3f2e19f', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-16fa3acd-3a3d-4ea2-996a-2676d869e429 req-6b3edb90-90ed-4634-aa88-41e29ce1d7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf494c03-d188-49c7-879e-29d2fa555549", "tag": "eafcafd8-d33e-48b1-9947-cbce2d458180"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-16fa3acd-3a3d-4ea2-996a-2676d869e429 req-6b3edb90-90ed-4634-aa88-41e29ce1d7d1 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-16fa3acd-3a3d-4ea2-996a-2676d869e429 req-6b3edb90-90ed-4634-aa88-41e29ce1d7d1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-16fa3acd-3a3d-4ea2-996a-2676d869e429 req-6b3edb90-90ed-4634-aa88-41e29ce1d7d1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:26 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1446443267", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e68379ef-0781-4af6-be68-a311cdded61e"}], "security_groups": [{"name": "tempest-securitygroup--1636518546"}], "key_name": "tempest-keypair-748576161", "user_data": "}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:26 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-16fa3acd-3a3d-4ea2-996a-2676d869e429 req-6b3edb90-90ed-4634-aa88-41e29ce1d7d1 service nova] Creating event network-changed:eafcafd8-d33e-48b1-9947-cbce2d458180 for instance cf494c03-d188-49c7-879e-29d2fa555549 on user Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-16fa3acd-3a3d-4ea2-996a-2676d869e429 req-6b3edb90-90ed-4634-aa88-41e29ce1d7d1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61648) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-16fa3acd-3a3d-4ea2-996a-2676d869e429 req-6b3edb90-90ed-4634-aa88-41e29ce1d7d1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61648) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:26 user devstack@n-api.service[61648]: INFO nova.compute.rpcapi [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 10:28:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] Releasing lock "compute-rpcapi-router" {{(pid=61648) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 10:28:26 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-6306eb2c-ca49-4872-b782-fd79afc1eec6 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169293 Apr 20 10:28:26 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 17/51] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:27 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-268849146", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a64312c6-b1a8-450f-9e8d-0cf0282aef90"}], "security_groups": [{"name": "tempest-securitygroup--1861203226"}], "key_name": "tempest-keypair-2096466478", "user_data": "}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:27 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] validate_networks() for [('e68379ef-0781-4af6-be68-a311cdded61e', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Getting quotas for project 2d1545b79af0497497e960cbd68aa8f2. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Getting quotas for user 2aef9efd33b946709d8f01f41b79f382 and project 2d1545b79af0497497e960cbd68aa8f2. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:28:27 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-1fc55f6a-1391-41bd-95c5-5cce87886a29 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.358324 Apr 20 10:28:27 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 18/52] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:28:24 2023] POST /compute/v2.1/servers => generated 404 bytes in 3360 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-40d38b4c-36b1-43bc-b1cd-1fa443904667 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-40d38b4c-36b1-43bc-b1cd-1fa443904667 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:28:27 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] validate_networks() for [('a64312c6-b1a8-450f-9e8d-0cf0282aef90', None, None, None, None, None)] {{(pid=61648) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-40d38b4c-36b1-43bc-b1cd-1fa443904667 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aef9efd33b946709d8f01f41b79f382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1545b79af0497497e960cbd68aa8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:28:27 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-40d38b4c-36b1-43bc-b1cd-1fa443904667 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70" status: 200 len: 1239 microversion: 2.1 time: 0.218623 Apr 20 10:28:27 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:28:27 2023] GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 => generated 1239 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:28:27 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-4fa17951-1e71-4047-9ffe-78fe14a46d53 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Action: 'create', calling method: .version_select at 0x7f122b295e10>, body: {"keypair": {"name": "tempest-keypair-1241550354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKo6j6WbCBGkhY+/90E7m8dSLZQNugKiG3Ze4NFSIzNr6U7x488jnMXjls3Or9lOdNpk237JBBGIDaL4rNwHM9ccpiAVRM3eozuQ2DPkyUdqXkWu62GoK7gs5ZQh/CHghQ=="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:28 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-4fa17951-1e71-4047-9ffe-78fe14a46d53 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Getting quotas for project 7c3ecc1463ec42eea56f2890b032ef7a. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:28 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-4fa17951-1e71-4047-9ffe-78fe14a46d53 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Getting quotas for user 712be6d6876f4b2c9d796e406a43f8bf and project 7c3ecc1463ec42eea56f2890b032ef7a. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:28 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-4fa17951-1e71-4047-9ffe-78fe14a46d53 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.372106 Apr 20 10:28:28 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 20/54] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:28:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Flavor limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Image limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Flavor pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Image pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for project 1b4a2af680394ec889b4661753658b01. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for user 67955d2e81c04b8d8dbcbe577303e025 and project 1b4a2af680394ec889b4661753658b01. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Going to run 1 instances... {{(pid=61648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:28:28 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:28:28 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f1e00853-89b1-4f49-8378-ca1cb6aeb820 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.575600 Apr 20 10:28:28 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:28:27 2023] POST /compute/v2.1/servers => generated 400 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:28:28 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-5778d605-ca6f-4370-aacf-48873b116de2 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:28:28 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-5778d605-ca6f-4370-aacf-48873b116de2 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:28:28 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-5778d605-ca6f-4370-aacf-48873b116de2 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67955d2e81c04b8d8dbcbe577303e025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4a2af680394ec889b4661753658b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:28:28 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-5778d605-ca6f-4370-aacf-48873b116de2 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42" status: 200 len: 1231 microversion: 2.1 time: 0.215474 Apr 20 10:28:28 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 21/56] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:28:28 2023] GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 => generated 1231 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Getting quotas for project 8d9c5dd66fd0496a8e92b41d98fe1727. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Getting quotas for user bc5470a076e14c218cf04fad713ce074 and project 8d9c5dd66fd0496a8e92b41d98fe1727. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:28:29 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:28:29 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-856f1ea8-6212-485f-8afc-ca7fad99b597 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.256687 Apr 20 10:28:29 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 18/57] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:28:26 2023] POST /compute/v2.1/servers => generated 407 bytes in 3258 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:28:29 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a49b77fd-aa6b-4f50-a958-cf18aa5fd736 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:28:29 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-a49b77fd-aa6b-4f50-a958-cf18aa5fd736 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:28:29 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-a49b77fd-aa6b-4f50-a958-cf18aa5fd736 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:28:29 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-a49b77fd-aa6b-4f50-a958-cf18aa5fd736 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1232 microversion: 2.1 time: 0.156794 Apr 20 10:28:29 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:28:29 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1232 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:28:31 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-42507989", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "55052d2c-5064-4bd3-9b46-6e90a5ee3def"}], "security_groups": [{"name": "tempest-securitygroup--1475647793"}], "key_name": "tempest-keypair-1241550354", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-a798dc8e-5be8-4532-9659-f944b6798947 req-0794ba74-ece7-494d-bd87-fcd711145a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf494c03-d188-49c7-879e-29d2fa555549", "name": "network-vif-plugged", "status": "completed", "tag": "eafcafd8-d33e-48b1-9947-cbce2d458180"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a798dc8e-5be8-4532-9659-f944b6798947 req-0794ba74-ece7-494d-bd87-fcd711145a00 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a798dc8e-5be8-4532-9659-f944b6798947 req-0794ba74-ece7-494d-bd87-fcd711145a00 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a798dc8e-5be8-4532-9659-f944b6798947 req-0794ba74-ece7-494d-bd87-fcd711145a00 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:32 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-a798dc8e-5be8-4532-9659-f944b6798947 req-0794ba74-ece7-494d-bd87-fcd711145a00 service nova] Creating event network-vif-plugged:eafcafd8-d33e-48b1-9947-cbce2d458180 for instance cf494c03-d188-49c7-879e-29d2fa555549 on user Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a798dc8e-5be8-4532-9659-f944b6798947 req-0794ba74-ece7-494d-bd87-fcd711145a00 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61647) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a798dc8e-5be8-4532-9659-f944b6798947 req-0794ba74-ece7-494d-bd87-fcd711145a00 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61647) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:32 user devstack@n-api.service[61647]: INFO nova.compute.rpcapi [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 10:28:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] Releasing lock "compute-rpcapi-router" {{(pid=61647) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 10:28:32 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-a8ebf1b2-e792-40e1-96b9-982b825b2ef1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165362 Apr 20 10:28:32 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 19/59] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:32 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] validate_networks() for [('55052d2c-5064-4bd3-9b46-6e90a5ee3def', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:28:33 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-1ec6c1c3-7dcd-4e45-83cc-55c8cedbd23b req-11db2226-f544-4eeb-ba99-0b0ec63f0da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48e6aa1-dd33-42a4-89c9-20691b628c70", "tag": "0954983e-5cb4-4486-9816-67f4f5f78b35"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1ec6c1c3-7dcd-4e45-83cc-55c8cedbd23b req-11db2226-f544-4eeb-ba99-0b0ec63f0da6 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1ec6c1c3-7dcd-4e45-83cc-55c8cedbd23b req-11db2226-f544-4eeb-ba99-0b0ec63f0da6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1ec6c1c3-7dcd-4e45-83cc-55c8cedbd23b req-11db2226-f544-4eeb-ba99-0b0ec63f0da6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:33 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-1ec6c1c3-7dcd-4e45-83cc-55c8cedbd23b req-11db2226-f544-4eeb-ba99-0b0ec63f0da6 service nova] Creating event network-changed:0954983e-5cb4-4486-9816-67f4f5f78b35 for instance f48e6aa1-dd33-42a4-89c9-20691b628c70 on user Apr 20 10:28:33 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-1ec6c1c3-7dcd-4e45-83cc-55c8cedbd23b req-11db2226-f544-4eeb-ba99-0b0ec63f0da6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042583 Apr 20 10:28:33 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Getting quotas for project 7c3ecc1463ec42eea56f2890b032ef7a. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Getting quotas for user 712be6d6876f4b2c9d796e406a43f8bf and project 7c3ecc1463ec42eea56f2890b032ef7a. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:28:33 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:28:33 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e21bbb5c-11c2-440c-b2f2-682cadd8bff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.018508 Apr 20 10:28:33 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 22/61] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:28:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:28:33 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-eb7d8156-c8d8-42ff-89d0-1224186f6cf9 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:28:33 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-eb7d8156-c8d8-42ff-89d0-1224186f6cf9 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:28:34 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-eb7d8156-c8d8-42ff-89d0-1224186f6cf9 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712be6d6876f4b2c9d796e406a43f8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ecc1463ec42eea56f2890b032ef7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:28:34 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-eb7d8156-c8d8-42ff-89d0-1224186f6cf9 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466" status: 200 len: 1234 microversion: 2.1 time: 0.136167 Apr 20 10:28:34 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 20/62] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:28:33 2023] GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466 => generated 1234 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 10:28:34 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-1ad79298-fe56-437b-a90f-bb086838ea9d req-2b7a6282-e4bd-445c-999e-5a9571884b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf494c03-d188-49c7-879e-29d2fa555549", "name": "network-vif-plugged", "status": "completed", "tag": "eafcafd8-d33e-48b1-9947-cbce2d458180"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1ad79298-fe56-437b-a90f-bb086838ea9d req-2b7a6282-e4bd-445c-999e-5a9571884b3f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1ad79298-fe56-437b-a90f-bb086838ea9d req-2b7a6282-e4bd-445c-999e-5a9571884b3f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1ad79298-fe56-437b-a90f-bb086838ea9d req-2b7a6282-e4bd-445c-999e-5a9571884b3f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:34 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-1ad79298-fe56-437b-a90f-bb086838ea9d req-2b7a6282-e4bd-445c-999e-5a9571884b3f service nova] Creating event network-vif-plugged:eafcafd8-d33e-48b1-9947-cbce2d458180 for instance cf494c03-d188-49c7-879e-29d2fa555549 on user Apr 20 10:28:34 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-1ad79298-fe56-437b-a90f-bb086838ea9d req-2b7a6282-e4bd-445c-999e-5a9571884b3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062189 Apr 20 10:28:34 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-e6a10af7-cbd1-47e9-ba96-d255190a98eb req-9a789ce7-f254-417e-b04f-d86b832fe56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7a669c-28aa-42d2-8991-5852336c0f42", "tag": "9bd8e190-3b17-470b-9274-5060f7875bba"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e6a10af7-cbd1-47e9-ba96-d255190a98eb req-9a789ce7-f254-417e-b04f-d86b832fe56b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e6a10af7-cbd1-47e9-ba96-d255190a98eb req-9a789ce7-f254-417e-b04f-d86b832fe56b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e6a10af7-cbd1-47e9-ba96-d255190a98eb req-9a789ce7-f254-417e-b04f-d86b832fe56b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-e6a10af7-cbd1-47e9-ba96-d255190a98eb req-9a789ce7-f254-417e-b04f-d86b832fe56b service nova] Creating event network-changed:9bd8e190-3b17-470b-9274-5060f7875bba for instance 0f7a669c-28aa-42d2-8991-5852336c0f42 on user Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e6a10af7-cbd1-47e9-ba96-d255190a98eb req-9a789ce7-f254-417e-b04f-d86b832fe56b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61649) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e6a10af7-cbd1-47e9-ba96-d255190a98eb req-9a789ce7-f254-417e-b04f-d86b832fe56b service nova] Acquired lock "compute-rpcapi-router" {{(pid=61649) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:35 user devstack@n-api.service[61649]: INFO nova.compute.rpcapi [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 10:28:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] Releasing lock "compute-rpcapi-router" {{(pid=61649) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 10:28:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-4f812a83-c70a-404e-8e3e-31e70d9cdfcf None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099617 Apr 20 10:28:35 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:36 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-4b20af73-7bed-4984-978b-6301af10acf4 req-2f96a1fd-fa7b-462d-a4d3-4e08ba93f66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48e6aa1-dd33-42a4-89c9-20691b628c70", "name": "network-vif-plugged", "status": "completed", "tag": "0954983e-5cb4-4486-9816-67f4f5f78b35"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-4b20af73-7bed-4984-978b-6301af10acf4 req-2f96a1fd-fa7b-462d-a4d3-4e08ba93f66e service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-4b20af73-7bed-4984-978b-6301af10acf4 req-2f96a1fd-fa7b-462d-a4d3-4e08ba93f66e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-4b20af73-7bed-4984-978b-6301af10acf4 req-2f96a1fd-fa7b-462d-a4d3-4e08ba93f66e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:36 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-4b20af73-7bed-4984-978b-6301af10acf4 req-2f96a1fd-fa7b-462d-a4d3-4e08ba93f66e service nova] Creating event network-vif-plugged:0954983e-5cb4-4486-9816-67f4f5f78b35 for instance f48e6aa1-dd33-42a4-89c9-20691b628c70 on user Apr 20 10:28:36 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-4b20af73-7bed-4984-978b-6301af10acf4 req-2f96a1fd-fa7b-462d-a4d3-4e08ba93f66e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038576 Apr 20 10:28:36 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:38 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:38 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-406b7ccb-e5df-419c-b25a-9cb4453ae72d req-3ddf4514-321f-4803-b8e1-e40f8de9f295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48e6aa1-dd33-42a4-89c9-20691b628c70", "name": "network-vif-plugged", "status": "completed", "tag": "0954983e-5cb4-4486-9816-67f4f5f78b35"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-406b7ccb-e5df-419c-b25a-9cb4453ae72d req-3ddf4514-321f-4803-b8e1-e40f8de9f295 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-406b7ccb-e5df-419c-b25a-9cb4453ae72d req-3ddf4514-321f-4803-b8e1-e40f8de9f295 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-406b7ccb-e5df-419c-b25a-9cb4453ae72d req-3ddf4514-321f-4803-b8e1-e40f8de9f295 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:38 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-406b7ccb-e5df-419c-b25a-9cb4453ae72d req-3ddf4514-321f-4803-b8e1-e40f8de9f295 service nova] Creating event network-vif-plugged:0954983e-5cb4-4486-9816-67f4f5f78b35 for instance f48e6aa1-dd33-42a4-89c9-20691b628c70 on user Apr 20 10:28:38 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-406b7ccb-e5df-419c-b25a-9cb4453ae72d req-3ddf4514-321f-4803-b8e1-e40f8de9f295 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053727 Apr 20 10:28:38 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:39 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-8cf55133-4ebf-47b1-98f3-b986c52c3acf req-408559e4-d0fc-454b-add7-4d3cf0ccd8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:39 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8cf55133-4ebf-47b1-98f3-b986c52c3acf req-408559e4-d0fc-454b-add7-4d3cf0ccd8d1 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:39 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8cf55133-4ebf-47b1-98f3-b986c52c3acf req-408559e4-d0fc-454b-add7-4d3cf0ccd8d1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:39 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8cf55133-4ebf-47b1-98f3-b986c52c3acf req-408559e4-d0fc-454b-add7-4d3cf0ccd8d1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:39 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-8cf55133-4ebf-47b1-98f3-b986c52c3acf req-408559e4-d0fc-454b-add7-4d3cf0ccd8d1 service nova] Creating event network-changed:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:28:39 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-8cf55133-4ebf-47b1-98f3-b986c52c3acf req-408559e4-d0fc-454b-add7-4d3cf0ccd8d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031988 Apr 20 10:28:39 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 24/67] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:39 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-3883f404-128d-44ba-986c-9bbcb093188d req-70da1afa-7d5d-43ee-9793-106cafd1a3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fb0d55-ef35-4386-86fe-00775b83a8d4", "tag": "851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-3883f404-128d-44ba-986c-9bbcb093188d req-70da1afa-7d5d-43ee-9793-106cafd1a3d0 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-3883f404-128d-44ba-986c-9bbcb093188d req-70da1afa-7d5d-43ee-9793-106cafd1a3d0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-3883f404-128d-44ba-986c-9bbcb093188d req-70da1afa-7d5d-43ee-9793-106cafd1a3d0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:39 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-3883f404-128d-44ba-986c-9bbcb093188d req-70da1afa-7d5d-43ee-9793-106cafd1a3d0 service nova] Creating event network-changed:851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1 for instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 on user Apr 20 10:28:39 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-3883f404-128d-44ba-986c-9bbcb093188d req-70da1afa-7d5d-43ee-9793-106cafd1a3d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178489 Apr 20 10:28:39 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:41 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=16 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:41 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-dbb96b87-7c81-4e70-a69b-94dc1afe23b7 req-6dad13cd-9a05-4313-8ef6-d9c8026ae141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7a669c-28aa-42d2-8991-5852336c0f42", "name": "network-vif-plugged", "status": "completed", "tag": "9bd8e190-3b17-470b-9274-5060f7875bba"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-dbb96b87-7c81-4e70-a69b-94dc1afe23b7 req-6dad13cd-9a05-4313-8ef6-d9c8026ae141 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-dbb96b87-7c81-4e70-a69b-94dc1afe23b7 req-6dad13cd-9a05-4313-8ef6-d9c8026ae141 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-dbb96b87-7c81-4e70-a69b-94dc1afe23b7 req-6dad13cd-9a05-4313-8ef6-d9c8026ae141 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:41 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-dbb96b87-7c81-4e70-a69b-94dc1afe23b7 req-6dad13cd-9a05-4313-8ef6-d9c8026ae141 service nova] Creating event network-vif-plugged:9bd8e190-3b17-470b-9274-5060f7875bba for instance 0f7a669c-28aa-42d2-8991-5852336c0f42 on user Apr 20 10:28:41 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-dbb96b87-7c81-4e70-a69b-94dc1afe23b7 req-6dad13cd-9a05-4313-8ef6-d9c8026ae141 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040131 Apr 20 10:28:41 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:44 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-1a82308e-456d-4b2e-81c2-57c974346635 req-2c4b2dae-81d4-4e70-9d3c-35043d473b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7a669c-28aa-42d2-8991-5852336c0f42", "name": "network-vif-plugged", "status": "completed", "tag": "9bd8e190-3b17-470b-9274-5060f7875bba"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:44 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-1a82308e-456d-4b2e-81c2-57c974346635 req-2c4b2dae-81d4-4e70-9d3c-35043d473b01 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:44 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-1a82308e-456d-4b2e-81c2-57c974346635 req-2c4b2dae-81d4-4e70-9d3c-35043d473b01 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:44 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-1a82308e-456d-4b2e-81c2-57c974346635 req-2c4b2dae-81d4-4e70-9d3c-35043d473b01 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:44 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-1a82308e-456d-4b2e-81c2-57c974346635 req-2c4b2dae-81d4-4e70-9d3c-35043d473b01 service nova] Creating event network-vif-plugged:9bd8e190-3b17-470b-9274-5060f7875bba for instance 0f7a669c-28aa-42d2-8991-5852336c0f42 on user Apr 20 10:28:44 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-1a82308e-456d-4b2e-81c2-57c974346635 req-2c4b2dae-81d4-4e70-9d3c-35043d473b01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055099 Apr 20 10:28:44 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 25/70] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:44 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:44 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-eb74b60a-6525-4167-9fb1-c65d87f67c61 req-5f7eb7f1-0ecd-43b9-b100-2fda2eb1d7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-plugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:44 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=14 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:44 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-eb74b60a-6525-4167-9fb1-c65d87f67c61 req-5f7eb7f1-0ecd-43b9-b100-2fda2eb1d7d7 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:44 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-eb74b60a-6525-4167-9fb1-c65d87f67c61 req-5f7eb7f1-0ecd-43b9-b100-2fda2eb1d7d7 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:44 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-eb74b60a-6525-4167-9fb1-c65d87f67c61 req-5f7eb7f1-0ecd-43b9-b100-2fda2eb1d7d7 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:44 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-eb74b60a-6525-4167-9fb1-c65d87f67c61 req-5f7eb7f1-0ecd-43b9-b100-2fda2eb1d7d7 service nova] Creating event network-vif-plugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:28:44 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-eb74b60a-6525-4167-9fb1-c65d87f67c61 req-5f7eb7f1-0ecd-43b9-b100-2fda2eb1d7d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097848 Apr 20 10:28:44 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:44 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-a716b319-6043-4ac4-aa5a-623b670693b6 req-2af4135d-e6a6-4b50-9c84-e1ef74d036fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fb0d55-ef35-4386-86fe-00775b83a8d4", "name": "network-vif-plugged", "status": "completed", "tag": "851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-a716b319-6043-4ac4-aa5a-623b670693b6 req-2af4135d-e6a6-4b50-9c84-e1ef74d036fa service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-a716b319-6043-4ac4-aa5a-623b670693b6 req-2af4135d-e6a6-4b50-9c84-e1ef74d036fa service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-a716b319-6043-4ac4-aa5a-623b670693b6 req-2af4135d-e6a6-4b50-9c84-e1ef74d036fa service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:44 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-a716b319-6043-4ac4-aa5a-623b670693b6 req-2af4135d-e6a6-4b50-9c84-e1ef74d036fa service nova] Creating event network-vif-plugged:851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1 for instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 on user Apr 20 10:28:44 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-a716b319-6043-4ac4-aa5a-623b670693b6 req-2af4135d-e6a6-4b50-9c84-e1ef74d036fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056039 Apr 20 10:28:44 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:46 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=26 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:46 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=8 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:46 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-67ffd02b-4bf1-4e8b-8bde-52e293236ea0 req-2bcf662e-ef20-40f9-b2b4-5a9befc1fa14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-plugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-67ffd02b-4bf1-4e8b-8bde-52e293236ea0 req-2bcf662e-ef20-40f9-b2b4-5a9befc1fa14 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-67ffd02b-4bf1-4e8b-8bde-52e293236ea0 req-2bcf662e-ef20-40f9-b2b4-5a9befc1fa14 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-67ffd02b-4bf1-4e8b-8bde-52e293236ea0 req-2bcf662e-ef20-40f9-b2b4-5a9befc1fa14 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:46 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-67ffd02b-4bf1-4e8b-8bde-52e293236ea0 req-2bcf662e-ef20-40f9-b2b4-5a9befc1fa14 service nova] Creating event network-vif-plugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:28:46 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-67ffd02b-4bf1-4e8b-8bde-52e293236ea0 req-2bcf662e-ef20-40f9-b2b4-5a9befc1fa14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036078 Apr 20 10:28:46 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 26/73] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:46 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-e01f255a-8cc9-4501-84b5-e2dd76b05479 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Action: 'create', calling method: .version_select at 0x7f122b2f7370>, body: {"keypair": {"name": "tempest-keypair-1802426226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbO3gWjR+kfpqealBy4YcF5JnglKkdA7HMnKPq7F8n83ZuToSao0nhpqddYS4a7HYIvtQt1kPTWohrL7u4lMFSRJRaAHMC0ISjFRgdgwi8OOridVoioARVP9cUAseOLWA=="}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:46 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-e01f255a-8cc9-4501-84b5-e2dd76b05479 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Getting quotas for project cb0f8979fdc4456db83cc88103856510. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:46 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-e01f255a-8cc9-4501-84b5-e2dd76b05479 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Getting quotas for user 6e5685756fe74751ad4c4fe85c30c951 and project cb0f8979fdc4456db83cc88103856510. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:46 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-e01f255a-8cc9-4501-84b5-e2dd76b05479 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.385228 Apr 20 10:28:46 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 24/74] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:28:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:47 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-6719b81a-1ecf-45bf-b87f-d25f4d6971b6 req-20621a90-4563-48e9-89d6-9eef44a872aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fb0d55-ef35-4386-86fe-00775b83a8d4", "name": "network-vif-plugged", "status": "completed", "tag": "851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-6719b81a-1ecf-45bf-b87f-d25f4d6971b6 req-20621a90-4563-48e9-89d6-9eef44a872aa service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-6719b81a-1ecf-45bf-b87f-d25f4d6971b6 req-20621a90-4563-48e9-89d6-9eef44a872aa service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-6719b81a-1ecf-45bf-b87f-d25f4d6971b6 req-20621a90-4563-48e9-89d6-9eef44a872aa service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:47 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-6719b81a-1ecf-45bf-b87f-d25f4d6971b6 req-20621a90-4563-48e9-89d6-9eef44a872aa service nova] Creating event network-vif-plugged:851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1 for instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 on user Apr 20 10:28:47 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-6719b81a-1ecf-45bf-b87f-d25f4d6971b6 req-20621a90-4563-48e9-89d6-9eef44a872aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072174 Apr 20 10:28:47 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:48 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1435500858", "imageRef": "9e8cd77e-f94e-4043-a953-9fb6fa201c58", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "5a79f1a7-4d58-42fc-9c84-6f9951485092"}], "security_groups": [{"name": "tempest-securitygroup--1387046503"}], "key_name": "tempest-keypair-1802426226", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:48 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] validate_networks() for [('5a79f1a7-4d58-42fc-9c84-6f9951485092', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=10 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=17 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Getting quotas for project cb0f8979fdc4456db83cc88103856510. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:28:49 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Getting quotas for user 6e5685756fe74751ad4c4fe85c30c951 and project cb0f8979fdc4456db83cc88103856510. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:28:50 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:28:50 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e8cd77e-f94e-4043-a953-9fb6fa201c58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:28:50 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-82ea6831-a543-4805-b9d6-1e593bd502c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.451410 Apr 20 10:28:50 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 27/76] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:28:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:28:50 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-c30747c4-8621-4881-a83c-27e9804cba75 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:28:50 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-c30747c4-8621-4881-a83c-27e9804cba75 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:28:50 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=5 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:50 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-c30747c4-8621-4881-a83c-27e9804cba75 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5685756fe74751ad4c4fe85c30c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0f8979fdc4456db83cc88103856510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:28:50 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-c30747c4-8621-4881-a83c-27e9804cba75 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a" status: 200 len: 1240 microversion: 2.1 time: 0.125777 Apr 20 10:28:50 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 25/77] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:28:50 2023] GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:28:54 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-48f93e6e-8a50-4800-afbb-cd09737d823b req-b796dd4f-c5cf-40b3-bb6f-7ec65c5ad735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:54 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:54 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-48f93e6e-8a50-4800-afbb-cd09737d823b req-b796dd4f-c5cf-40b3-bb6f-7ec65c5ad735 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:54 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-48f93e6e-8a50-4800-afbb-cd09737d823b req-b796dd4f-c5cf-40b3-bb6f-7ec65c5ad735 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:54 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-48f93e6e-8a50-4800-afbb-cd09737d823b req-b796dd4f-c5cf-40b3-bb6f-7ec65c5ad735 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:54 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=19 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:54 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-48f93e6e-8a50-4800-afbb-cd09737d823b req-b796dd4f-c5cf-40b3-bb6f-7ec65c5ad735 service nova] Creating event network-changed:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:28:54 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-48f93e6e-8a50-4800-afbb-cd09737d823b req-b796dd4f-c5cf-40b3-bb6f-7ec65c5ad735 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035960 Apr 20 10:28:54 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:56 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-b85258e9-2666-469d-8601-4aac511a8a5b req-ead47a37-a628-4435-8c03-66a576ea87df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-plugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b85258e9-2666-469d-8601-4aac511a8a5b req-ead47a37-a628-4435-8c03-66a576ea87df service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b85258e9-2666-469d-8601-4aac511a8a5b req-ead47a37-a628-4435-8c03-66a576ea87df service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b85258e9-2666-469d-8601-4aac511a8a5b req-ead47a37-a628-4435-8c03-66a576ea87df service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:57 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-b85258e9-2666-469d-8601-4aac511a8a5b req-ead47a37-a628-4435-8c03-66a576ea87df service nova] Creating event network-vif-plugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:28:57 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-b85258e9-2666-469d-8601-4aac511a8a5b req-ead47a37-a628-4435-8c03-66a576ea87df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Apr 20 10:28:57 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 28/79] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:28:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-6e1ef1c2-2246-46e1-88b6-c0b7bad6100b req-40bc311d-c9af-4cea-ad07-572ccd578cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-plugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:28:59 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=12 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:28:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-6e1ef1c2-2246-46e1-88b6-c0b7bad6100b req-40bc311d-c9af-4cea-ad07-572ccd578cbd service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:28:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-6e1ef1c2-2246-46e1-88b6-c0b7bad6100b req-40bc311d-c9af-4cea-ad07-572ccd578cbd service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:28:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-6e1ef1c2-2246-46e1-88b6-c0b7bad6100b req-40bc311d-c9af-4cea-ad07-572ccd578cbd service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:28:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-6e1ef1c2-2246-46e1-88b6-c0b7bad6100b req-40bc311d-c9af-4cea-ad07-572ccd578cbd service nova] Creating event network-vif-plugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:28:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-6e1ef1c2-2246-46e1-88b6-c0b7bad6100b req-40bc311d-c9af-4cea-ad07-572ccd578cbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076487 Apr 20 10:28:59 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 26/80] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:28:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:29:09 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:09 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-304888933", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "324b6a85-3443-483c-bd8e-4a128c9daf02"}]}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:29:09 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] validate_networks() for [('324b6a85-3443-483c-bd8e-4a128c9daf02', None, None, None, None, None)] {{(pid=61648) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Flavor limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Image limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Flavor pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Image pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Getting quotas for project 3d65a1127ac04ac8976d9fbb08197248. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Getting quotas for user 8355ed1609024bc1a30cbc422d8f90c2 and project 3d65a1127ac04ac8976d9fbb08197248. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Going to run 1 instances... {{(pid=61648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:29:10 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] [instance: 23940921-698b-4e96-8aed-2d1c8c12299f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:29:10 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-d4197410-cb17-4a9a-adaa-d7a2d2de32ec tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.750170 Apr 20 10:29:10 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 27/81] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:29:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:29:10 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:10 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:10 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:10 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:10 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-3edf39b3-d733-43e6-8c01-44dc174b9242 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:10 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-3edf39b3-d733-43e6-8c01-44dc174b9242 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] [instance: 23940921-698b-4e96-8aed-2d1c8c12299f] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:29:10 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-3edf39b3-d733-43e6-8c01-44dc174b9242 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8355ed1609024bc1a30cbc422d8f90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d65a1127ac04ac8976d9fbb08197248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:29:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-3edf39b3-d733-43e6-8c01-44dc174b9242 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f" status: 200 len: 1207 microversion: 2.1 time: 0.081795 Apr 20 10:29:10 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 29/82] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:29:10 2023] GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f => generated 1207 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=5 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] [instance: cf494c03-d188-49c7-879e-29d2fa555549] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:11 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f64a72e9ec4ad599a5c63bec4d092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f986df042c594f71a4db3da582def690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:29:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-a03424f9-8ab7-4da9-9894-ca7b235c4958 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549" status: 200 len: 1490 microversion: 2.1 time: 0.404185 Apr 20 10:29:11 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 27/83] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:29:11 2023] GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549 => generated 1490 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:29:13 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-4544b413-ead5-4531-bb98-6692c2594e85 req-74faeb87-3137-4aef-8818-6daf7908bb5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23940921-698b-4e96-8aed-2d1c8c12299f", "tag": "9c8c1513-213f-430e-8807-4172515e6170"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:29:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4544b413-ead5-4531-bb98-6692c2594e85 req-74faeb87-3137-4aef-8818-6daf7908bb5f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4544b413-ead5-4531-bb98-6692c2594e85 req-74faeb87-3137-4aef-8818-6daf7908bb5f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4544b413-ead5-4531-bb98-6692c2594e85 req-74faeb87-3137-4aef-8818-6daf7908bb5f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-4544b413-ead5-4531-bb98-6692c2594e85 req-74faeb87-3137-4aef-8818-6daf7908bb5f service nova] Creating event network-changed:9c8c1513-213f-430e-8807-4172515e6170 for instance 23940921-698b-4e96-8aed-2d1c8c12299f on user Apr 20 10:29:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-4544b413-ead5-4531-bb98-6692c2594e85 req-74faeb87-3137-4aef-8818-6daf7908bb5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038520 Apr 20 10:29:13 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:29:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:29:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-410b5371-47dc-4bdf-8c88-d7a3773b54bf req-4710d69b-8990-43b2-8937-44325338b31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23940921-698b-4e96-8aed-2d1c8c12299f", "name": "network-vif-plugged", "status": "completed", "tag": "9c8c1513-213f-430e-8807-4172515e6170"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:29:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-410b5371-47dc-4bdf-8c88-d7a3773b54bf req-4710d69b-8990-43b2-8937-44325338b31a service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-410b5371-47dc-4bdf-8c88-d7a3773b54bf req-4710d69b-8990-43b2-8937-44325338b31a service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-410b5371-47dc-4bdf-8c88-d7a3773b54bf req-4710d69b-8990-43b2-8937-44325338b31a service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-410b5371-47dc-4bdf-8c88-d7a3773b54bf req-4710d69b-8990-43b2-8937-44325338b31a service nova] Creating event network-vif-plugged:9c8c1513-213f-430e-8807-4172515e6170 for instance 23940921-698b-4e96-8aed-2d1c8c12299f on user Apr 20 10:29:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-410b5371-47dc-4bdf-8c88-d7a3773b54bf req-4710d69b-8990-43b2-8937-44325338b31a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027992 Apr 20 10:29:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 30/85] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:29:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:29:17 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-785f0761-41e6-40f1-bccb-a7524e919294 req-1ae5b5ce-f721-4921-990f-a23ed7f8c90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23940921-698b-4e96-8aed-2d1c8c12299f", "name": "network-vif-plugged", "status": "completed", "tag": "9c8c1513-213f-430e-8807-4172515e6170"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:29:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-785f0761-41e6-40f1-bccb-a7524e919294 req-1ae5b5ce-f721-4921-990f-a23ed7f8c90b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-785f0761-41e6-40f1-bccb-a7524e919294 req-1ae5b5ce-f721-4921-990f-a23ed7f8c90b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-785f0761-41e6-40f1-bccb-a7524e919294 req-1ae5b5ce-f721-4921-990f-a23ed7f8c90b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:17 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-785f0761-41e6-40f1-bccb-a7524e919294 req-1ae5b5ce-f721-4921-990f-a23ed7f8c90b service nova] Creating event network-vif-plugged:9c8c1513-213f-430e-8807-4172515e6170 for instance 23940921-698b-4e96-8aed-2d1c8c12299f on user Apr 20 10:29:17 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-785f0761-41e6-40f1-bccb-a7524e919294 req-1ae5b5ce-f721-4921-990f-a23ed7f8c90b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035159 Apr 20 10:29:17 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 28/86] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:29:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:18 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aef9efd33b946709d8f01f41b79f382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1545b79af0497497e960cbd68aa8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:29:18 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-19c1245c-1c95-4709-933e-202d18de7bf4 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70" status: 200 len: 1553 microversion: 2.1 time: 0.295860 Apr 20 10:29:18 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 29/87] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:29:17 2023] GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:19 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67955d2e81c04b8d8dbcbe577303e025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4a2af680394ec889b4661753658b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:29:19 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-c53d6e8e-26b9-4f03-8eda-fb3688eb037a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42" status: 200 len: 1537 microversion: 2.1 time: 0.327065 Apr 20 10:29:19 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 31/88] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:29:18 2023] GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-dbfdd256-1aa1-41ae-a42c-96582d4b6ef8 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Action: 'create', calling method: .version_select at 0x7f122a947ac0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-719364947", "metadata": {"Type": "work"}}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-dbfdd256-1aa1-41ae-a42c-96582d4b6ef8 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Request method failure captured: Apr 20 10:29:19 user devstack@n-api.service[61647]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 10:29:19 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:29:19 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:29:19 user devstack@n-api.service[61647]: Connection: close Apr 20 10:29:19 user devstack@n-api.service[61647]: Content-Length: 121 Apr 20 10:29:19 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:29:19 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:29:19 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:29:19 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRP_2beQuoMWGDw1QBiMIslWstw3Iz6jVfIa7Q1Ym9_zxb7yRuqPeIePvnPNNZSxHvDS0htWMxVtojOjVHuyn9pQDOhqOREN1PO4iO2Ir8MqHTIMXnj8UnzJgHpbuponwH1_N0j7uVu_Z-8PjOBe6L7-bvm-nJ4sDZ1Ziy72KYbby4o Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Id: 4bdd25aa80aa4bbf800de7924dfeff70 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Name: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61647]: Apr 20 10:29:19 user devstack@n-api.service[61647]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-719364947", "metadata": {"Type": "work"}}} Apr 20 10:29:19 user devstack@n-api.service[61647]: method: Apr 20 10:29:19 user devstack@n-api.service[61647]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61647]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-719364947', 'metadata': {'Type': 'work'}}}} Apr 20 10:29:19 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise error Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi '#$%' Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-dbfdd256-1aa1-41ae-a42c-96582d4b6ef8 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:29:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-dbfdd256-1aa1-41ae-a42c-96582d4b6ef8 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.185794 Apr 20 10:29:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 29/89] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 10:29:19 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-bb9f79d6-036c-447c-9b00-03c723e1f0f2 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Action: 'create', calling method: .version_select at 0x7f122b1c8430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2056621016", "metadata": {"Type": "work"}}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-bb9f79d6-036c-447c-9b00-03c723e1f0f2 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Request method failure captured: Apr 20 10:29:19 user devstack@n-api.service[61648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 10:29:19 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:29:19 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:29:19 user devstack@n-api.service[61648]: Connection: close Apr 20 10:29:19 user devstack@n-api.service[61648]: Content-Length: 120 Apr 20 10:29:19 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:29:19 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:29:19 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:29:19 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRP_2beQuoMWGDw1QBiMIslWstw3Iz6jVfIa7Q1Ym9_zxb7yRuqPeIePvnPNNZSxHvDS0htWMxVtojOjVHuyn9pQDOhqOREN1PO4iO2Ir8MqHTIMXnj8UnzJgHpbuponwH1_N0j7uVu_Z-8PjOBe6L7-bvm-nJ4sDZ1Ziy72KYbby4o Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Project-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Project-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Tenant: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Tenant-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61648]: X-User: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61648]: X-User-Id: 4bdd25aa80aa4bbf800de7924dfeff70 Apr 20 10:29:19 user devstack@n-api.service[61648]: X-User-Name: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61648]: Apr 20 10:29:19 user devstack@n-api.service[61648]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2056621016", "metadata": {"Type": "work"}}} Apr 20 10:29:19 user devstack@n-api.service[61648]: method: Apr 20 10:29:19 user devstack@n-api.service[61648]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 10:29:19 user devstack@n-api.service[61648]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2056621016', 'metadata': {'Type': 'work'}}}} Apr 20 10:29:19 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise error Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi '0' Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 10:29:19 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-bb9f79d6-036c-447c-9b00-03c723e1f0f2 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:29:19 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-bb9f79d6-036c-447c-9b00-03c723e1f0f2 tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013393 Apr 20 10:29:19 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 10:29:19 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-db4c8a87-0ab7-4b40-9ddc-40d59dfb53ff tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Action: 'create', calling method: .version_select at 0x7f122a94ab00>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2023183125", "metadata": {"Type": "work"}}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:29:19 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-db4c8a87-0ab7-4b40-9ddc-40d59dfb53ff tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Request method failure captured: Apr 20 10:29:19 user devstack@n-api.service[61649]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 10:29:19 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:29:19 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:29:19 user devstack@n-api.service[61649]: Connection: close Apr 20 10:29:19 user devstack@n-api.service[61649]: Content-Length: 119 Apr 20 10:29:19 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:29:19 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:29:19 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:29:19 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRP_2beQuoMWGDw1QBiMIslWstw3Iz6jVfIa7Q1Ym9_zxb7yRuqPeIePvnPNNZSxHvDS0htWMxVtojOjVHuyn9pQDOhqOREN1PO4iO2Ir8MqHTIMXnj8UnzJgHpbuponwH1_N0j7uVu_Z-8PjOBe6L7-bvm-nJ4sDZ1Ziy72KYbby4o Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Project-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Project-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Tenant: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Tenant-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61649]: X-User: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61649]: X-User-Id: 4bdd25aa80aa4bbf800de7924dfeff70 Apr 20 10:29:19 user devstack@n-api.service[61649]: X-User-Name: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61649]: Apr 20 10:29:19 user devstack@n-api.service[61649]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2023183125", "metadata": {"Type": "work"}}} Apr 20 10:29:19 user devstack@n-api.service[61649]: method: Apr 20 10:29:19 user devstack@n-api.service[61649]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61649]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2023183125', 'metadata': {'Type': 'work'}}}} Apr 20 10:29:19 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise error Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi '' Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 10:29:19 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-db4c8a87-0ab7-4b40-9ddc-40d59dfb53ff tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:29:19 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-db4c8a87-0ab7-4b40-9ddc-40d59dfb53ff tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011393 Apr 20 10:29:19 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 32/91] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 10:29:19 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-777d1b6c-9c65-43f2-b38d-245b52a22d4f tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Calling method '.version_select at 0x7f122a9b95a0>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-777d1b6c-9c65-43f2-b38d-245b52a22d4f tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] HTTP exception thrown: Volume tempest-invalid-1016519194 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-777d1b6c-9c65-43f2-b38d-245b52a22d4f tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Request method failure captured: Apr 20 10:29:19 user devstack@n-api.service[61647]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1016519194 HTTP/1.1 Apr 20 10:29:19 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:29:19 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:29:19 user devstack@n-api.service[61647]: Connection: close Apr 20 10:29:19 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:29:19 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:29:19 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:29:19 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:29:19 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRP_2beQuoMWGDw1QBiMIslWstw3Iz6jVfIa7Q1Ym9_zxb7yRuqPeIePvnPNNZSxHvDS0htWMxVtojOjVHuyn9pQDOhqOREN1PO4iO2Ir8MqHTIMXnj8UnzJgHpbuponwH1_N0j7uVu_Z-8PjOBe6L7-bvm-nJ4sDZ1Ziy72KYbby4o Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Id: 4bdd25aa80aa4bbf800de7924dfeff70 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Name: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61647]: method: Apr 20 10:29:19 user devstack@n-api.service[61647]: exception: Volume tempest-invalid-1016519194 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: action_args: {'id': 'tempest-invalid-1016519194'} Apr 20 10:29:19 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1016519194 could not be found. (HTTP 404) (Request-ID: req-16c475ec-13f5-438a-9c37-47bf3ebd55a5) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1016519194 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1016519194 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1016519194 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-777d1b6c-9c65-43f2-b38d-245b52a22d4f tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Returning 404 to user: Volume tempest-invalid-1016519194 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:29:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-777d1b6c-9c65-43f2-b38d-245b52a22d4f tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1016519194" status: 404 len: 99 microversion: 2.1 time: 0.064999 Apr 20 10:29:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 30/92] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 10:29:19 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1016519194 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-c8436bcd-bfeb-43f8-b4fb-fa7df843700b tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004486 Apr 20 10:29:19 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 20 10:29:19 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-d8c8b2bf-a6a9-480b-b589-1d2c27011ebb tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006920 Apr 20 10:29:19 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 33/94] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 20 10:29:19 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-52b803c6-15d3-4292-ac09-66a78721b3ac tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Calling method '.version_select at 0x7f122a9b91b0>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-52b803c6-15d3-4292-ac09-66a78721b3ac tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] HTTP exception thrown: Volume 3572f557-371d-4ed1-a232-9952122d1737 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-52b803c6-15d3-4292-ac09-66a78721b3ac tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Request method failure captured: Apr 20 10:29:19 user devstack@n-api.service[61647]: request: DELETE /compute/v2.1/os-volumes/3572f557-371d-4ed1-a232-9952122d1737 HTTP/1.1 Apr 20 10:29:19 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:29:19 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:29:19 user devstack@n-api.service[61647]: Connection: close Apr 20 10:29:19 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:29:19 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:29:19 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:29:19 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:29:19 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRP_2beQuoMWGDw1QBiMIslWstw3Iz6jVfIa7Q1Ym9_zxb7yRuqPeIePvnPNNZSxHvDS0htWMxVtojOjVHuyn9pQDOhqOREN1PO4iO2Ir8MqHTIMXnj8UnzJgHpbuponwH1_N0j7uVu_Z-8PjOBe6L7-bvm-nJ4sDZ1Ziy72KYbby4o Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Project-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Id: 4bdd25aa80aa4bbf800de7924dfeff70 Apr 20 10:29:19 user devstack@n-api.service[61647]: X-User-Name: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:19 user devstack@n-api.service[61647]: method: Apr 20 10:29:19 user devstack@n-api.service[61647]: exception: Volume 3572f557-371d-4ed1-a232-9952122d1737 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: action_args: {'id': '3572f557-371d-4ed1-a232-9952122d1737'} Apr 20 10:29:19 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3572f557-371d-4ed1-a232-9952122d1737 could not be found. (HTTP 404) (Request-ID: req-1637aebc-877b-41db-b6a4-fc6448d6fd2a) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3572f557-371d-4ed1-a232-9952122d1737 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3572f557-371d-4ed1-a232-9952122d1737 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3572f557-371d-4ed1-a232-9952122d1737 could not be found. Apr 20 10:29:19 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:29:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-52b803c6-15d3-4292-ac09-66a78721b3ac tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Returning 404 to user: Volume 3572f557-371d-4ed1-a232-9952122d1737 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:29:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-52b803c6-15d3-4292-ac09-66a78721b3ac tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3572f557-371d-4ed1-a232-9952122d1737" status: 404 len: 109 microversion: 2.1 time: 0.038841 Apr 20 10:29:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 31/95] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:29:19 2023] DELETE /compute/v2.1/os-volumes/3572f557-371d-4ed1-a232-9952122d1737 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:19 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-75b876c1-8d93-4dcd-9e20-c5b540396edd tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Calling method '.version_select at 0x7f122a94ab00>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:20 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-75b876c1-8d93-4dcd-9e20-c5b540396edd tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] HTTP exception thrown: Volume 4594c429-1a10-4e7b-8862-10fe1af3a7b0 could not be found. Apr 20 10:29:20 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-75b876c1-8d93-4dcd-9e20-c5b540396edd tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Request method failure captured: Apr 20 10:29:20 user devstack@n-api.service[61649]: request: GET /compute/v2.1/os-volumes/4594c429-1a10-4e7b-8862-10fe1af3a7b0 HTTP/1.1 Apr 20 10:29:20 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:29:20 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:29:20 user devstack@n-api.service[61649]: Connection: close Apr 20 10:29:20 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:29:20 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:29:20 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:29:20 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:29:20 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRP_2beQuoMWGDw1QBiMIslWstw3Iz6jVfIa7Q1Ym9_zxb7yRuqPeIePvnPNNZSxHvDS0htWMxVtojOjVHuyn9pQDOhqOREN1PO4iO2Ir8MqHTIMXnj8UnzJgHpbuponwH1_N0j7uVu_Z-8PjOBe6L7-bvm-nJ4sDZ1Ziy72KYbby4o Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Project-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Project-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2bc2f47e5b9947b7a3e0841a145e1861"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Tenant: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Tenant-Id: 2bc2f47e5b9947b7a3e0841a145e1861 Apr 20 10:29:20 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-VolumesNegativeTest-649322846 Apr 20 10:29:20 user devstack@n-api.service[61649]: X-User: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:20 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:29:20 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:29:20 user devstack@n-api.service[61649]: X-User-Id: 4bdd25aa80aa4bbf800de7924dfeff70 Apr 20 10:29:20 user devstack@n-api.service[61649]: X-User-Name: tempest-VolumesNegativeTest-649322846-project-member Apr 20 10:29:20 user devstack@n-api.service[61649]: method: Apr 20 10:29:20 user devstack@n-api.service[61649]: exception: Volume 4594c429-1a10-4e7b-8862-10fe1af3a7b0 could not be found. Apr 20 10:29:20 user devstack@n-api.service[61649]: action_args: {'id': '4594c429-1a10-4e7b-8862-10fe1af3a7b0'} Apr 20 10:29:20 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4594c429-1a10-4e7b-8862-10fe1af3a7b0 could not be found. (HTTP 404) (Request-ID: req-00adac89-8e48-4417-b26a-6f3394d82ece) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4594c429-1a10-4e7b-8862-10fe1af3a7b0 could not be found. Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4594c429-1a10-4e7b-8862-10fe1af3a7b0 could not be found. Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4594c429-1a10-4e7b-8862-10fe1af3a7b0 could not be found. Apr 20 10:29:20 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:29:20 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-75b876c1-8d93-4dcd-9e20-c5b540396edd tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] Returning 404 to user: Volume 4594c429-1a10-4e7b-8862-10fe1af3a7b0 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:29:20 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-75b876c1-8d93-4dcd-9e20-c5b540396edd tempest-VolumesNegativeTest-649322846 tempest-VolumesNegativeTest-649322846-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4594c429-1a10-4e7b-8862-10fe1af3a7b0" status: 404 len: 109 microversion: 2.1 time: 0.078223 Apr 20 10:29:20 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 34/96] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 10:29:19 2023] GET /compute/v2.1/os-volumes/4594c429-1a10-4e7b-8862-10fe1af3a7b0 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:29:20 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:20 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:29:20 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-88a53bf5-826c-4368-bb1c-e9eb036a1ff8 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1539 microversion: 2.1 time: 0.220258 Apr 20 10:29:20 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 32/97] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:29:19 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:24 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712be6d6876f4b2c9d796e406a43f8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ecc1463ec42eea56f2890b032ef7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:29:24 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-6c457f4c-71c8-4531-83c3-5f66b2e17e8a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466" status: 200 len: 1544 microversion: 2.1 time: 0.233520 Apr 20 10:29:24 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 32/98] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:29:24 2023] GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466 => generated 1544 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=8 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=8 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:29:40 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5685756fe74751ad4c4fe85c30c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0f8979fdc4456db83cc88103856510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:29:40 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e13c8a3f-0d4f-467f-988d-a40ef16c47c6 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a" status: 200 len: 1551 microversion: 2.1 time: 0.268154 Apr 20 10:29:40 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 35/99] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:29:40 2023] GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a => generated 1551 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] [instance: 23940921-698b-4e96-8aed-2d1c8c12299f] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=16 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:00 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8355ed1609024bc1a30cbc422d8f90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d65a1127ac04ac8976d9fbb08197248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:30:00 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-9ce22405-6080-4f9d-8eb4-cfaebd3fd8a8 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f" status: 200 len: 1485 microversion: 2.1 time: 0.272171 Apr 20 10:30:00 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 33/100] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:30:00 2023] GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f => generated 1485 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=14 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] [instance: cf494c03-d188-49c7-879e-29d2fa555549] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:13 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] [instance: cf494c03-d188-49c7-879e-29d2fa555549] Going to try to terminate instance {{(pid=61647) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:30:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-b2da604f-6cf6-4ab6-b5cf-9497d414fbb9 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549" status: 204 len: 0 microversion: 2.1 time: 0.385310 Apr 20 10:30:13 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 33/101] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:30:13 2023] DELETE /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] [instance: cf494c03-d188-49c7-879e-29d2fa555549] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:13 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25f64a72e9ec4ad599a5c63bec4d092e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f986df042c594f71a4db3da582def690', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:30:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-fac8a747-efc6-44f4-b477-1775ee956c84 tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549" status: 200 len: 1496 microversion: 2.1 time: 0.297124 Apr 20 10:30:13 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 36/102] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:30:13 2023] GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549 => generated 1496 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:13 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-88ee509d-45d9-466e-83b8-e369a5c19878 req-8990f45c-259d-496d-bc53-1663d617070b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf494c03-d188-49c7-879e-29d2fa555549", "name": "network-vif-unplugged", "status": "completed", "tag": "eafcafd8-d33e-48b1-9947-cbce2d458180"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:13 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:13 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-88ee509d-45d9-466e-83b8-e369a5c19878 req-8990f45c-259d-496d-bc53-1663d617070b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-88ee509d-45d9-466e-83b8-e369a5c19878 req-8990f45c-259d-496d-bc53-1663d617070b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-88ee509d-45d9-466e-83b8-e369a5c19878 req-8990f45c-259d-496d-bc53-1663d617070b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-88ee509d-45d9-466e-83b8-e369a5c19878 req-8990f45c-259d-496d-bc53-1663d617070b service nova] Creating event network-vif-unplugged:eafcafd8-d33e-48b1-9947-cbce2d458180 for instance cf494c03-d188-49c7-879e-29d2fa555549 on user Apr 20 10:30:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-88ee509d-45d9-466e-83b8-e369a5c19878 req-8990f45c-259d-496d-bc53-1663d617070b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038380 Apr 20 10:30:13 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 34/103] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:14 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-64694571-8896-4167-b87d-47df8c0198a2 req-2e8de904-45dd-431e-90ed-47faf79804aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf494c03-d188-49c7-879e-29d2fa555549", "name": "network-vif-deleted", "tag": "eafcafd8-d33e-48b1-9947-cbce2d458180"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:14 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-64694571-8896-4167-b87d-47df8c0198a2 req-2e8de904-45dd-431e-90ed-47faf79804aa service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:14 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-64694571-8896-4167-b87d-47df8c0198a2 req-2e8de904-45dd-431e-90ed-47faf79804aa service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:14 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-64694571-8896-4167-b87d-47df8c0198a2 req-2e8de904-45dd-431e-90ed-47faf79804aa service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:14 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-64694571-8896-4167-b87d-47df8c0198a2 req-2e8de904-45dd-431e-90ed-47faf79804aa service nova] Creating event network-vif-deleted:eafcafd8-d33e-48b1-9947-cbce2d458180 for instance cf494c03-d188-49c7-879e-29d2fa555549 on user Apr 20 10:30:14 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-64694571-8896-4167-b87d-47df8c0198a2 req-2e8de904-45dd-431e-90ed-47faf79804aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037477 Apr 20 10:30:14 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 34/104] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-d49e36f6-752e-4f12-b6c2-f75262a9fd9f req-671426e6-ce42-4ecd-975a-3a323fd464d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf494c03-d188-49c7-879e-29d2fa555549", "name": "network-vif-plugged", "status": "completed", "tag": "eafcafd8-d33e-48b1-9947-cbce2d458180"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-d49e36f6-752e-4f12-b6c2-f75262a9fd9f req-671426e6-ce42-4ecd-975a-3a323fd464d6 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-d49e36f6-752e-4f12-b6c2-f75262a9fd9f req-671426e6-ce42-4ecd-975a-3a323fd464d6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-d49e36f6-752e-4f12-b6c2-f75262a9fd9f req-671426e6-ce42-4ecd-975a-3a323fd464d6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-d49e36f6-752e-4f12-b6c2-f75262a9fd9f req-671426e6-ce42-4ecd-975a-3a323fd464d6 service nova] Creating event network-vif-plugged:eafcafd8-d33e-48b1-9947-cbce2d458180 for instance cf494c03-d188-49c7-879e-29d2fa555549 on user Apr 20 10:30:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-d49e36f6-752e-4f12-b6c2-f75262a9fd9f req-671426e6-ce42-4ecd-975a-3a323fd464d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034632 Apr 20 10:30:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 37/105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:18 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-a1fe538d-872d-4cc8-85bb-6d2795f01285 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.206213 Apr 20 10:30:18 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 35/106] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:30:18 2023] GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70/os-interface => generated 282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-650384c0-52ae-441b-9acf-c7b4a4a5d655 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.181791 Apr 20 10:30:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:30:19 2023] GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42/os-interface => generated 283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:19 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-3fdd2724-f19e-4751-a876-33c6410490c4 req-5c4cb22a-ac3d-453b-9cad-2ef4127475b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48e6aa1-dd33-42a4-89c9-20691b628c70", "tag": "0954983e-5cb4-4486-9816-67f4f5f78b35"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:19 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-3fdd2724-f19e-4751-a876-33c6410490c4 req-5c4cb22a-ac3d-453b-9cad-2ef4127475b6 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:19 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-3fdd2724-f19e-4751-a876-33c6410490c4 req-5c4cb22a-ac3d-453b-9cad-2ef4127475b6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:19 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-3fdd2724-f19e-4751-a876-33c6410490c4 req-5c4cb22a-ac3d-453b-9cad-2ef4127475b6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:19 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-3fdd2724-f19e-4751-a876-33c6410490c4 req-5c4cb22a-ac3d-453b-9cad-2ef4127475b6 service nova] Creating event network-changed:0954983e-5cb4-4486-9816-67f4f5f78b35 for instance f48e6aa1-dd33-42a4-89c9-20691b628c70 on user Apr 20 10:30:19 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-3fdd2724-f19e-4751-a876-33c6410490c4 req-5c4cb22a-ac3d-453b-9cad-2ef4127475b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038394 Apr 20 10:30:19 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 38/108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-135359299"}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:20 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-1af01c94-409a-4baf-a932-856bdef9d019 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70/action" status: 202 len: 0 microversion: 2.1 time: 0.909663 Apr 20 10:30:20 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 36/109] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 10:30:19 2023] POST /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70/action => generated 0 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 20 10:30:20 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-260276b3-12c7-44e7-b065-c4461c40debf tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '.version_select at 0x7f122a876d40>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:20 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-f892a8e4-e5ac-48e0-a6db-d149fd0f03f5 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.460985 Apr 20 10:30:20 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 36/110] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:30:20 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4/os-interface => generated 283 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:20 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-260276b3-12c7-44e7-b065-c4461c40debf tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445" status: 200 len: 1610 microversion: 2.1 time: 0.053823 Apr 20 10:30:20 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 39/111] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 10:30:20 2023] GET /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445 => generated 1610 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:21 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-1842dd69-dc45-467e-aa46-8a125931e9d4 req-c7fa387c-9b3f-4e4a-8b80-e4d9a91b2399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7a669c-28aa-42d2-8991-5852336c0f42", "tag": "9bd8e190-3b17-470b-9274-5060f7875bba"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1842dd69-dc45-467e-aa46-8a125931e9d4 req-c7fa387c-9b3f-4e4a-8b80-e4d9a91b2399 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1842dd69-dc45-467e-aa46-8a125931e9d4 req-c7fa387c-9b3f-4e4a-8b80-e4d9a91b2399 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-1842dd69-dc45-467e-aa46-8a125931e9d4 req-c7fa387c-9b3f-4e4a-8b80-e4d9a91b2399 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:21 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-1842dd69-dc45-467e-aa46-8a125931e9d4 req-c7fa387c-9b3f-4e4a-8b80-e4d9a91b2399 service nova] Creating event network-changed:9bd8e190-3b17-470b-9274-5060f7875bba for instance 0f7a669c-28aa-42d2-8991-5852336c0f42 on user Apr 20 10:30:21 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-1842dd69-dc45-467e-aa46-8a125931e9d4 req-c7fa387c-9b3f-4e4a-8b80-e4d9a91b2399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029775 Apr 20 10:30:21 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 37/112] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-28fab35c-af91-4b0e-bf13-be496beca6f9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42/ips" status: 200 len: 104 microversion: 2.1 time: 0.035823 Apr 20 10:30:21 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 37/113] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:30:21 2023] GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42/ips => generated 104 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-fa40d346-6960-49ac-9a5f-d58af3b3633a req-fd0a69fa-f90a-4fe1-9251-b737e211353c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64fb0d55-ef35-4386-86fe-00775b83a8d4", "tag": "851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-fa40d346-6960-49ac-9a5f-d58af3b3633a req-fd0a69fa-f90a-4fe1-9251-b737e211353c service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-fa40d346-6960-49ac-9a5f-d58af3b3633a req-fd0a69fa-f90a-4fe1-9251-b737e211353c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-fa40d346-6960-49ac-9a5f-d58af3b3633a req-fd0a69fa-f90a-4fe1-9251-b737e211353c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-fa40d346-6960-49ac-9a5f-d58af3b3633a req-fd0a69fa-f90a-4fe1-9251-b737e211353c service nova] Creating event network-changed:851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1 for instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 on user Apr 20 10:30:22 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-fa40d346-6960-49ac-9a5f-d58af3b3633a req-fd0a69fa-f90a-4fe1-9251-b737e211353c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032171 Apr 20 10:30:22 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 40/114] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:30:22 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-75100357-58e0-4001-be9e-b24a719dc204 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1539 microversion: 2.1 time: 0.263195 Apr 20 10:30:22 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 38/115] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:30:22 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1539 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:30:22 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-ba22b4be-c11a-42f5-82f1-45d1f6c91cb4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1539 microversion: 2.1 time: 0.160137 Apr 20 10:30:22 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:30:22 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1539 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:30:22 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-21eb42ab-ecdf-4d6a-af9e-59fd7de86f65 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42" status: 204 len: 0 microversion: 2.1 time: 0.165852 Apr 20 10:30:22 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 41/117] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:30:22 2023] DELETE /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:23 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67955d2e81c04b8d8dbcbe577303e025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4a2af680394ec889b4661753658b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:30:23 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-b1d28a3f-56dc-4ecc-a900-15dc1981ac8e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42" status: 200 len: 1662 microversion: 2.1 time: 0.340832 Apr 20 10:30:23 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:30:22 2023] GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 => generated 1662 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:24 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-b9e3515e-1946-4b8b-acdf-d89dcbe373c2 req-37937407-b43c-453b-98c6-f2af984ce6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7a669c-28aa-42d2-8991-5852336c0f42", "name": "network-vif-unplugged", "status": "completed", "tag": "9bd8e190-3b17-470b-9274-5060f7875bba"}, {"server_uuid": "0f7a669c-28aa-42d2-8991-5852336c0f42", "name": "network-vif-plugged", "status": "completed", "tag": "9bd8e190-3b17-470b-9274-5060f7875bba"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-b9e3515e-1946-4b8b-acdf-d89dcbe373c2 req-37937407-b43c-453b-98c6-f2af984ce6f1 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-b9e3515e-1946-4b8b-acdf-d89dcbe373c2 req-37937407-b43c-453b-98c6-f2af984ce6f1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-b9e3515e-1946-4b8b-acdf-d89dcbe373c2 req-37937407-b43c-453b-98c6-f2af984ce6f1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:24 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-b9e3515e-1946-4b8b-acdf-d89dcbe373c2 req-37937407-b43c-453b-98c6-f2af984ce6f1 service nova] Creating event network-vif-unplugged:9bd8e190-3b17-470b-9274-5060f7875bba for instance 0f7a669c-28aa-42d2-8991-5852336c0f42 on user Apr 20 10:30:24 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-b9e3515e-1946-4b8b-acdf-d89dcbe373c2 req-37937407-b43c-453b-98c6-f2af984ce6f1 service nova] Creating event network-vif-plugged:9bd8e190-3b17-470b-9274-5060f7875bba for instance 0f7a669c-28aa-42d2-8991-5852336c0f42 on user Apr 20 10:30:24 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-b9e3515e-1946-4b8b-acdf-d89dcbe373c2 req-37937407-b43c-453b-98c6-f2af984ce6f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028272 Apr 20 10:30:24 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:24 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-7052163b-a713-4820-9c54-dcb13c500c7a tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.382394 Apr 20 10:30:24 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 42/120] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:30:24 2023] GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466/os-interface => generated 282 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:25 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-ca39cf93-ce8c-40f0-8ca9-aa14657d3dfa req-55f93bba-c9ec-4b85-b63e-d48c0f101029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ca39cf93-ce8c-40f0-8ca9-aa14657d3dfa req-55f93bba-c9ec-4b85-b63e-d48c0f101029 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ca39cf93-ce8c-40f0-8ca9-aa14657d3dfa req-55f93bba-c9ec-4b85-b63e-d48c0f101029 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ca39cf93-ce8c-40f0-8ca9-aa14657d3dfa req-55f93bba-c9ec-4b85-b63e-d48c0f101029 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:25 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-ca39cf93-ce8c-40f0-8ca9-aa14657d3dfa req-55f93bba-c9ec-4b85-b63e-d48c0f101029 service nova] Creating event network-changed:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:30:25 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-ca39cf93-ce8c-40f0-8ca9-aa14657d3dfa req-55f93bba-c9ec-4b85-b63e-d48c0f101029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030954 Apr 20 10:30:25 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:26 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-246832cd-0f25-409e-83a0-7e2457ea435c req-57a5f7d9-7591-40b9-93cc-f9c1e9e645d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7a669c-28aa-42d2-8991-5852336c0f42", "name": "network-vif-deleted", "tag": "9bd8e190-3b17-470b-9274-5060f7875bba"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-246832cd-0f25-409e-83a0-7e2457ea435c req-57a5f7d9-7591-40b9-93cc-f9c1e9e645d5 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-246832cd-0f25-409e-83a0-7e2457ea435c req-57a5f7d9-7591-40b9-93cc-f9c1e9e645d5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-246832cd-0f25-409e-83a0-7e2457ea435c req-57a5f7d9-7591-40b9-93cc-f9c1e9e645d5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:26 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-246832cd-0f25-409e-83a0-7e2457ea435c req-57a5f7d9-7591-40b9-93cc-f9c1e9e645d5 service nova] Creating event network-vif-deleted:9bd8e190-3b17-470b-9274-5060f7875bba for instance 0f7a669c-28aa-42d2-8991-5852336c0f42 on user Apr 20 10:30:26 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-246832cd-0f25-409e-83a0-7e2457ea435c req-57a5f7d9-7591-40b9-93cc-f9c1e9e645d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030270 Apr 20 10:30:26 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1784158863", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "55052d2c-5064-4bd3-9b46-6e90a5ee3def"}]}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] validate_networks() for [('55052d2c-5064-4bd3-9b46-6e90a5ee3def', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Getting quotas for project 7c3ecc1463ec42eea56f2890b032ef7a. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Getting quotas for user 712be6d6876f4b2c9d796e406a43f8bf and project 7c3ecc1463ec42eea56f2890b032ef7a. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:30:27 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: db38a0ab-0165-480d-bddb-cab50bcd22e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:30:27 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-c0c6203c-6eda-4bf3-862e-277dfbb8f9c7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.579819 Apr 20 10:30:27 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 43/123] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:30:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:30:27 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-91b2a475-92d1-47c0-a7c5-3eb8ae33cff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:27 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-91b2a475-92d1-47c0-a7c5-3eb8ae33cff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: db38a0ab-0165-480d-bddb-cab50bcd22e4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:28 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-91b2a475-92d1-47c0-a7c5-3eb8ae33cff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712be6d6876f4b2c9d796e406a43f8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ecc1463ec42eea56f2890b032ef7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:30:28 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-91b2a475-92d1-47c0-a7c5-3eb8ae33cff7 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4" status: 200 len: 1212 microversion: 2.1 time: 0.091943 Apr 20 10:30:28 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:30:27 2023] GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4 => generated 1212 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:30 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-61a04983-f5d9-42ef-978a-7e57fef8ebf0 req-a93edca3-b903-4f76-898d-829c2f778cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db38a0ab-0165-480d-bddb-cab50bcd22e4", "tag": "7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-61a04983-f5d9-42ef-978a-7e57fef8ebf0 req-a93edca3-b903-4f76-898d-829c2f778cda service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-61a04983-f5d9-42ef-978a-7e57fef8ebf0 req-a93edca3-b903-4f76-898d-829c2f778cda service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-61a04983-f5d9-42ef-978a-7e57fef8ebf0 req-a93edca3-b903-4f76-898d-829c2f778cda service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:30 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-61a04983-f5d9-42ef-978a-7e57fef8ebf0 req-a93edca3-b903-4f76-898d-829c2f778cda service nova] Creating event network-changed:7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee for instance db38a0ab-0165-480d-bddb-cab50bcd22e4 on user Apr 20 10:30:30 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-61a04983-f5d9-42ef-978a-7e57fef8ebf0 req-a93edca3-b903-4f76-898d-829c2f778cda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038233 Apr 20 10:30:30 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:32 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-8f0e9a2e-4b86-453b-bd1e-a4c8194e6537 req-fcff3081-8ad5-48af-9565-2a50884ef454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db38a0ab-0165-480d-bddb-cab50bcd22e4", "name": "network-vif-plugged", "status": "completed", "tag": "7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8f0e9a2e-4b86-453b-bd1e-a4c8194e6537 req-fcff3081-8ad5-48af-9565-2a50884ef454 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8f0e9a2e-4b86-453b-bd1e-a4c8194e6537 req-fcff3081-8ad5-48af-9565-2a50884ef454 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8f0e9a2e-4b86-453b-bd1e-a4c8194e6537 req-fcff3081-8ad5-48af-9565-2a50884ef454 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:32 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-8f0e9a2e-4b86-453b-bd1e-a4c8194e6537 req-fcff3081-8ad5-48af-9565-2a50884ef454 service nova] Creating event network-vif-plugged:7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee for instance db38a0ab-0165-480d-bddb-cab50bcd22e4 on user Apr 20 10:30:32 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-8f0e9a2e-4b86-453b-bd1e-a4c8194e6537 req-fcff3081-8ad5-48af-9565-2a50884ef454 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029734 Apr 20 10:30:32 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 44/126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:34 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-ffaffcc9-6d43-4d2a-9a82-13833567bce4 req-1207a24b-5570-4329-91c8-dab1e60c7ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db38a0ab-0165-480d-bddb-cab50bcd22e4", "name": "network-vif-plugged", "status": "completed", "tag": "7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ffaffcc9-6d43-4d2a-9a82-13833567bce4 req-1207a24b-5570-4329-91c8-dab1e60c7ef3 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ffaffcc9-6d43-4d2a-9a82-13833567bce4 req-1207a24b-5570-4329-91c8-dab1e60c7ef3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ffaffcc9-6d43-4d2a-9a82-13833567bce4 req-1207a24b-5570-4329-91c8-dab1e60c7ef3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:34 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-ffaffcc9-6d43-4d2a-9a82-13833567bce4 req-1207a24b-5570-4329-91c8-dab1e60c7ef3 service nova] Creating event network-vif-plugged:7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee for instance db38a0ab-0165-480d-bddb-cab50bcd22e4 on user Apr 20 10:30:34 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-ffaffcc9-6d43-4d2a-9a82-13833567bce4 req-1207a24b-5570-4329-91c8-dab1e60c7ef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239490 Apr 20 10:30:34 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 42/127] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:40 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:40 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-bccbf7b8-935b-4389-a02a-24443c374dda tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.175678 Apr 20 10:30:40 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:30:40 2023] GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a/os-interface => generated 283 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:41 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:41 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:41 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-34361cbe-1c86-457c-bce5-e531156732e4 req-7311309a-ccae-42df-acb6-cbb3bb55575e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-34361cbe-1c86-457c-bce5-e531156732e4 req-7311309a-ccae-42df-acb6-cbb3bb55575e service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-34361cbe-1c86-457c-bce5-e531156732e4 req-7311309a-ccae-42df-acb6-cbb3bb55575e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-34361cbe-1c86-457c-bce5-e531156732e4 req-7311309a-ccae-42df-acb6-cbb3bb55575e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:41 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-34361cbe-1c86-457c-bce5-e531156732e4 req-7311309a-ccae-42df-acb6-cbb3bb55575e service nova] Creating event network-changed:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:41 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-34361cbe-1c86-457c-bce5-e531156732e4 req-7311309a-ccae-42df-acb6-cbb3bb55575e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031249 Apr 20 10:30:41 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 45/129] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:42 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:30:43 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-bc830912-9819-4265-a5f0-79890d07adea tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a" status: 204 len: 0 microversion: 2.1 time: 0.118254 Apr 20 10:30:43 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:30:42 2023] DELETE /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:43 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5685756fe74751ad4c4fe85c30c951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb0f8979fdc4456db83cc88103856510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:30:43 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-50818b15-b06a-48e3-a0a9-c39984890f60 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a" status: 200 len: 1675 microversion: 2.1 time: 0.272253 Apr 20 10:30:43 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:30:43 2023] GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:30:43 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-c5b912b3-b9f4-4f83-9c9e-61ac941caa31 req-a9a76739-9e20-4d42-a90b-4775755576ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:43 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:43 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-c5b912b3-b9f4-4f83-9c9e-61ac941caa31 req-a9a76739-9e20-4d42-a90b-4775755576ef service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:43 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-c5b912b3-b9f4-4f83-9c9e-61ac941caa31 req-a9a76739-9e20-4d42-a90b-4775755576ef service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:43 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-c5b912b3-b9f4-4f83-9c9e-61ac941caa31 req-a9a76739-9e20-4d42-a90b-4775755576ef service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:43 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:43 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-c5b912b3-b9f4-4f83-9c9e-61ac941caa31 req-a9a76739-9e20-4d42-a90b-4775755576ef service nova] Creating event network-vif-unplugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:43 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-c5b912b3-b9f4-4f83-9c9e-61ac941caa31 req-a9a76739-9e20-4d42-a90b-4775755576ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031946 Apr 20 10:30:43 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 46/132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:44 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-063fc45c-8dfb-4a5d-bf0f-b2bc75fbb1d0 req-c9d9777a-2251-4b05-a7cf-b93166d03056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-deleted", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:44 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-063fc45c-8dfb-4a5d-bf0f-b2bc75fbb1d0 req-c9d9777a-2251-4b05-a7cf-b93166d03056 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-063fc45c-8dfb-4a5d-bf0f-b2bc75fbb1d0 req-c9d9777a-2251-4b05-a7cf-b93166d03056 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-063fc45c-8dfb-4a5d-bf0f-b2bc75fbb1d0 req-c9d9777a-2251-4b05-a7cf-b93166d03056 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:44 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:30:44 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-063fc45c-8dfb-4a5d-bf0f-b2bc75fbb1d0 req-c9d9777a-2251-4b05-a7cf-b93166d03056 service nova] Creating event network-vif-deleted:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:44 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-063fc45c-8dfb-4a5d-bf0f-b2bc75fbb1d0 req-c9d9777a-2251-4b05-a7cf-b93166d03056 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Apr 20 10:30:44 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:30:45 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-plugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}, {"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-plugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}, {"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-plugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}, {"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}, {"server_uuid": "bf7d300f-b748-446b-97ce-6cae12609e7a", "name": "network-vif-plugged", "status": "completed", "tag": "ffe07547-7e1b-4f9e-afa9-31ccb5dca61d"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:30:45 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:30:45 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:30:45 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:30:45 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Creating event network-vif-plugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:45 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Creating event network-vif-plugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:45 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Creating event network-vif-plugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:45 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Creating event network-vif-unplugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:45 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] Creating event network-vif-plugged:ffe07547-7e1b-4f9e-afa9-31ccb5dca61d for instance bf7d300f-b748-446b-97ce-6cae12609e7a on user Apr 20 10:30:45 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-aaf67b1a-dd8b-4ebf-8aa3-5e509bf8acce req-f80ccc53-8886-4d73-a0b4-98421e1283a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.031394 Apr 20 10:30:45 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 44/134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:30:45 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] [instance: 23940921-698b-4e96-8aed-2d1c8c12299f] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:02 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] [instance: 23940921-698b-4e96-8aed-2d1c8c12299f] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:31:02 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-c0bd887b-7684-4f2a-b350-11faf6884902 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f" status: 204 len: 0 microversion: 2.1 time: 0.121826 Apr 20 10:31:02 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 47/135] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:31:02 2023] DELETE /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] [instance: 23940921-698b-4e96-8aed-2d1c8c12299f] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-2c5b8805-b211-462e-bb9a-0d82a911f93b req-ddc6a37e-3bc4-40f6-8134-6ed7f4f94cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23940921-698b-4e96-8aed-2d1c8c12299f", "name": "network-vif-unplugged", "status": "completed", "tag": "9c8c1513-213f-430e-8807-4172515e6170"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:02 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:02 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=12 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-2c5b8805-b211-462e-bb9a-0d82a911f93b req-ddc6a37e-3bc4-40f6-8134-6ed7f4f94cf3 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-2c5b8805-b211-462e-bb9a-0d82a911f93b req-ddc6a37e-3bc4-40f6-8134-6ed7f4f94cf3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-2c5b8805-b211-462e-bb9a-0d82a911f93b req-ddc6a37e-3bc4-40f6-8134-6ed7f4f94cf3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-2c5b8805-b211-462e-bb9a-0d82a911f93b req-ddc6a37e-3bc4-40f6-8134-6ed7f4f94cf3 service nova] Creating event network-vif-unplugged:9c8c1513-213f-430e-8807-4172515e6170 for instance 23940921-698b-4e96-8aed-2d1c8c12299f on user Apr 20 10:31:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-2c5b8805-b211-462e-bb9a-0d82a911f93b req-ddc6a37e-3bc4-40f6-8134-6ed7f4f94cf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032274 Apr 20 10:31:02 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 45/136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:02 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8355ed1609024bc1a30cbc422d8f90c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d65a1127ac04ac8976d9fbb08197248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:02 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-96a5c8ff-9223-404c-a28a-f3e909097308 tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f" status: 200 len: 1491 microversion: 2.1 time: 0.315948 Apr 20 10:31:02 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 45/137] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:02 2023] GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f => generated 1491 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] [instance: cf494c03-d188-49c7-879e-29d2fa555549] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] HTTP exception thrown: Instance cf494c03-d188-49c7-879e-29d2fa555549 could not be found. Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Request method failure captured: Apr 20 10:31:03 user devstack@n-api.service[61649]: request: GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549 HTTP/1.1 Apr 20 10:31:03 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:31:03 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:31:03 user devstack@n-api.service[61649]: Connection: close Apr 20 10:31:03 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:31:03 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:31:03 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:31:03 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:31:03 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRPCI-j2ug07iyZYIuzt4Vc_bE1XXfM31OSGF7K4r1pfgCx6UW98Eu1ROiOo6-W_U9XtrUaL4nMXPjl-IptYs-UFhB4OOWi8jDObUgQhl4LGCwlt47VQB8tpsOlqMKXvwxsrpj6NRYifF_RODHAo9SmqxgE85bSwimF_t7gwb4UIfkY Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Project-Id: f986df042c594f71a4db3da582def690 Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Project-Name: tempest-DeleteServersTestJSON-1091162656 Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f986df042c594f71a4db3da582def690"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f986df042c594f71a4db3da582def690"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f986df042c594f71a4db3da582def690"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Tenant: tempest-DeleteServersTestJSON-1091162656 Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Tenant-Id: f986df042c594f71a4db3da582def690 Apr 20 10:31:03 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-DeleteServersTestJSON-1091162656 Apr 20 10:31:03 user devstack@n-api.service[61649]: X-User: tempest-DeleteServersTestJSON-1091162656-project-member Apr 20 10:31:03 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:31:03 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:31:03 user devstack@n-api.service[61649]: X-User-Id: 25f64a72e9ec4ad599a5c63bec4d092e Apr 20 10:31:03 user devstack@n-api.service[61649]: X-User-Name: tempest-DeleteServersTestJSON-1091162656-project-member Apr 20 10:31:03 user devstack@n-api.service[61649]: method: > Apr 20 10:31:03 user devstack@n-api.service[61649]: exception: Instance cf494c03-d188-49c7-879e-29d2fa555549 could not be found. Apr 20 10:31:03 user devstack@n-api.service[61649]: action_args: {'id': 'cf494c03-d188-49c7-879e-29d2fa555549'} Apr 20 10:31:03 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf494c03-d188-49c7-879e-29d2fa555549 could not be found. Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf494c03-d188-49c7-879e-29d2fa555549 could not be found. Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf494c03-d188-49c7-879e-29d2fa555549 could not be found. Apr 20 10:31:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] Returning 404 to user: Instance cf494c03-d188-49c7-879e-29d2fa555549 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:31:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-38c3c0a3-08ae-4f49-8daa-1dcfbe3f631b tempest-DeleteServersTestJSON-1091162656 tempest-DeleteServersTestJSON-1091162656-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549" status: 404 len: 111 microversion: 2.1 time: 0.031422 Apr 20 10:31:03 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 48/138] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:03 2023] GET /compute/v2.1/servers/cf494c03-d188-49c7-879e-29d2fa555549 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:31:04 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-782bbe41-a2b5-42d7-8dba-a79c34ef1239 req-7794c99f-094a-49ce-9a3d-dfe186ed11b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23940921-698b-4e96-8aed-2d1c8c12299f", "name": "network-vif-plugged", "status": "completed", "tag": "9c8c1513-213f-430e-8807-4172515e6170"}, {"server_uuid": "23940921-698b-4e96-8aed-2d1c8c12299f", "name": "network-vif-deleted", "tag": "9c8c1513-213f-430e-8807-4172515e6170"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-782bbe41-a2b5-42d7-8dba-a79c34ef1239 req-7794c99f-094a-49ce-9a3d-dfe186ed11b1 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-782bbe41-a2b5-42d7-8dba-a79c34ef1239 req-7794c99f-094a-49ce-9a3d-dfe186ed11b1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-782bbe41-a2b5-42d7-8dba-a79c34ef1239 req-7794c99f-094a-49ce-9a3d-dfe186ed11b1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:04 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-782bbe41-a2b5-42d7-8dba-a79c34ef1239 req-7794c99f-094a-49ce-9a3d-dfe186ed11b1 service nova] Creating event network-vif-plugged:9c8c1513-213f-430e-8807-4172515e6170 for instance 23940921-698b-4e96-8aed-2d1c8c12299f on user Apr 20 10:31:04 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-782bbe41-a2b5-42d7-8dba-a79c34ef1239 req-7794c99f-094a-49ce-9a3d-dfe186ed11b1 service nova] Creating event network-vif-deleted:9c8c1513-213f-430e-8807-4172515e6170 for instance 23940921-698b-4e96-8aed-2d1c8c12299f on user Apr 20 10:31:04 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-782bbe41-a2b5-42d7-8dba-a79c34ef1239 req-7794c99f-094a-49ce-9a3d-dfe186ed11b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027412 Apr 20 10:31:04 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:10 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-dfdff17e-c603-41c7-a2f6-adc25910d4a9 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '.version_select at 0x7f122a8856c0>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:10 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-dfdff17e-c603-41c7-a2f6-adc25910d4a9 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445" status: 200 len: 1724 microversion: 2.1 time: 0.053123 Apr 20 10:31:10 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 46/140] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 10:31:10 2023] GET /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445 => generated 1724 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:10 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-54d6ab6d-8baf-47d7-a2e3-af7a0dd6013d tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '.version_select at 0x7f122a6236d0>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-54d6ab6d-8baf-47d7-a2e3-af7a0dd6013d tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445" status: 200 len: 1724 microversion: 2.1 time: 0.049834 Apr 20 10:31:10 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 49/141] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 10:31:10 2023] GET /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445 => generated 1724 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:11 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aef9efd33b946709d8f01f41b79f382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1545b79af0497497e960cbd68aa8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-11494eb3-6da5-458f-be56-a6fac1dfd7be tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70" status: 200 len: 1672 microversion: 2.1 time: 0.284739 Apr 20 10:31:11 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:10 2023] GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 => generated 1672 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:12 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:12 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-bc284f6c-1c02-42eb-9fd4-197183d00ba3 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.226286 Apr 20 10:31:12 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 47/143] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:12 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:13 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-5cdd62f1-13eb-447f-bb15-b160a8931522 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.404319 Apr 20 10:31:13 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 50/144] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:12 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] HTTP exception thrown: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Request method failure captured: Apr 20 10:31:13 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 HTTP/1.1 Apr 20 10:31:13 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:31:13 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:31:13 user devstack@n-api.service[61647]: Connection: close Apr 20 10:31:13 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:31:13 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:31:13 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:31:13 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:31:13 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRPBCOVlJJsxrIu6MU4L3RLp2zYN_qN67GVRvcPxtpP4wNQNDE8yUeeAqodk6psZpFdsHcATmByVsWQU6rVQnC81YTZTzQz-0leU2j-_i7hdAuhSwrhexIYFVHPtQHmW1SexytXyP0JcaGhgoPaLXXRDfUWHJsV6TjWzjq9dxE6woQ8 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Project-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b4a2af680394ec889b4661753658b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Tenant-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:31:13 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:31:13 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:31:13 user devstack@n-api.service[61647]: X-User-Id: 67955d2e81c04b8d8dbcbe577303e025 Apr 20 10:31:13 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:31:13 user devstack@n-api.service[61647]: method: > Apr 20 10:31:13 user devstack@n-api.service[61647]: exception: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:31:13 user devstack@n-api.service[61647]: action_args: {'id': '0f7a669c-28aa-42d2-8991-5852336c0f42'} Apr 20 10:31:13 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:31:13 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Returning 404 to user: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:31:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-58f316ec-9a1d-4b08-b0a1-6da70440fc9e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42" status: 404 len: 111 microversion: 2.1 time: 0.040442 Apr 20 10:31:13 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:13 2023] GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:31:13 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-1a22bbd1-d4db-489b-a2ed-692f61df7dd4 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '.version_select at 0x7f122b1c9870>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-1a22bbd1-d4db-489b-a2ed-692f61df7dd4 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096466478" status: 202 len: 0 microversion: 2.1 time: 0.024374 Apr 20 10:31:13 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 48/146] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 10:31:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2096466478 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:31:14 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f2a3365b-8ff0-424c-8e30-5a451203866f tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Action: 'create', calling method: .version_select at 0x7f122a623250>, body: {"keypair": {"name": "tempest-keypair-262941358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ5hWqMeQoiTjX1acBo0XOFkMSjsm4q8qCy1ebdaywrtaD1l+xT9hnnoXuRjhZSD6F7eyAs+ruYJLSMyK+7gGsfIukb8brNhWiGX5TJye8A1hd9hjeQcPgsM9lbt6bNyw=="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:14 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-f2a3365b-8ff0-424c-8e30-5a451203866f tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for project 1b4a2af680394ec889b4661753658b01. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:31:14 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-f2a3365b-8ff0-424c-8e30-5a451203866f tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for user 67955d2e81c04b8d8dbcbe577303e025 and project 1b4a2af680394ec889b4661753658b01. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:31:14 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f2a3365b-8ff0-424c-8e30-5a451203866f tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058757 Apr 20 10:31:14 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 51/147] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:31:14 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:16 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1492863401", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a64312c6-b1a8-450f-9e8d-0cf0282aef90"}], "security_groups": [{"name": "tempest-securitygroup--958558230"}], "key_name": "tempest-keypair-262941358", "user_data": "}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:16 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] validate_networks() for [('a64312c6-b1a8-450f-9e8d-0cf0282aef90', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for project 1b4a2af680394ec889b4661753658b01. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Getting quotas for user 67955d2e81c04b8d8dbcbe577303e025 and project 1b4a2af680394ec889b4661753658b01. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:31:17 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:31:17 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-aa17d251-e31e-465b-88bb-b227c0b8ca6c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.688864 Apr 20 10:31:17 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 49/148] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:31:16 2023] POST /compute/v2.1/servers => generated 399 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:31:17 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-909b5ed8-7c22-4039-a283-0b51d1be331c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:17 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-909b5ed8-7c22-4039-a283-0b51d1be331c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:17 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-909b5ed8-7c22-4039-a283-0b51d1be331c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67955d2e81c04b8d8dbcbe577303e025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4a2af680394ec889b4661753658b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:17 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-909b5ed8-7c22-4039-a283-0b51d1be331c tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af" status: 200 len: 1231 microversion: 2.1 time: 0.133972 Apr 20 10:31:17 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 49/149] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:17 2023] GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af => generated 1231 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: db38a0ab-0165-480d-bddb-cab50bcd22e4] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:18 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712be6d6876f4b2c9d796e406a43f8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ecc1463ec42eea56f2890b032ef7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:18 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-585f0c79-50fd-41c1-a08c-55a2488fb401 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4" status: 200 len: 1496 microversion: 2.1 time: 0.243217 Apr 20 10:31:18 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 52/150] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:18 2023] GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4 => generated 1496 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:21 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-a6d43192-e111-4588-997d-505a22c9d7d4 req-03aa7ae6-850f-4707-b8cf-66d042bb8d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af", "tag": "3a9efede-078b-4adc-9b72-465253f4444d"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a6d43192-e111-4588-997d-505a22c9d7d4 req-03aa7ae6-850f-4707-b8cf-66d042bb8d2f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a6d43192-e111-4588-997d-505a22c9d7d4 req-03aa7ae6-850f-4707-b8cf-66d042bb8d2f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a6d43192-e111-4588-997d-505a22c9d7d4 req-03aa7ae6-850f-4707-b8cf-66d042bb8d2f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-a6d43192-e111-4588-997d-505a22c9d7d4 req-03aa7ae6-850f-4707-b8cf-66d042bb8d2f service nova] Creating event network-changed:3a9efede-078b-4adc-9b72-465253f4444d for instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af on user Apr 20 10:31:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-a6d43192-e111-4588-997d-505a22c9d7d4 req-03aa7ae6-850f-4707-b8cf-66d042bb8d2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029490 Apr 20 10:31:21 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:24 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-40d3c7e7-3a61-43d1-a242-4b388123fe42 req-19278890-779f-40b1-a395-709831a751ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af", "name": "network-vif-plugged", "status": "completed", "tag": "3a9efede-078b-4adc-9b72-465253f4444d"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:24 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=13 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-40d3c7e7-3a61-43d1-a242-4b388123fe42 req-19278890-779f-40b1-a395-709831a751ff service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-40d3c7e7-3a61-43d1-a242-4b388123fe42 req-19278890-779f-40b1-a395-709831a751ff service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-40d3c7e7-3a61-43d1-a242-4b388123fe42 req-19278890-779f-40b1-a395-709831a751ff service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:24 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-40d3c7e7-3a61-43d1-a242-4b388123fe42 req-19278890-779f-40b1-a395-709831a751ff service nova] Creating event network-vif-plugged:3a9efede-078b-4adc-9b72-465253f4444d for instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af on user Apr 20 10:31:24 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-40d3c7e7-3a61-43d1-a242-4b388123fe42 req-19278890-779f-40b1-a395-709831a751ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053533 Apr 20 10:31:24 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 50/152] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:26 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-c4743f78-b09d-4d5c-9786-72528946711f req-cb8c8649-f44a-48ad-bb2f-53a210b2f1ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af", "name": "network-vif-plugged", "status": "completed", "tag": "3a9efede-078b-4adc-9b72-465253f4444d"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:26 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:26 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-c4743f78-b09d-4d5c-9786-72528946711f req-cb8c8649-f44a-48ad-bb2f-53a210b2f1ba service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:26 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-c4743f78-b09d-4d5c-9786-72528946711f req-cb8c8649-f44a-48ad-bb2f-53a210b2f1ba service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:26 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-c4743f78-b09d-4d5c-9786-72528946711f req-cb8c8649-f44a-48ad-bb2f-53a210b2f1ba service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:26 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-c4743f78-b09d-4d5c-9786-72528946711f req-cb8c8649-f44a-48ad-bb2f-53a210b2f1ba service nova] Creating event network-vif-plugged:3a9efede-078b-4adc-9b72-465253f4444d for instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af on user Apr 20 10:31:26 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-c4743f78-b09d-4d5c-9786-72528946711f req-cb8c8649-f44a-48ad-bb2f-53a210b2f1ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033099 Apr 20 10:31:26 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 53/153] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=16 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:33 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] HTTP exception thrown: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Request method failure captured: Apr 20 10:31:33 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a HTTP/1.1 Apr 20 10:31:33 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:31:33 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:31:33 user devstack@n-api.service[61647]: Connection: close Apr 20 10:31:33 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:31:33 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:31:33 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:31:33 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:31:33 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRO928thBXTmf9dE0dLFT2Uai3m5liNw-MfjuZ-cNKGSXdQCFFPMVJ5d9xb4syGwkDUwDcN-CvwokB_Ts4uNljF2yzEXi-66yxaYSODVPsIIRAw2aI8IViM2SpVC19hqBVbQmHDgPBvC1OYpokZmrMcIyA4cCH8eUgwhySZ86tDtVh4 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Project-Id: cb0f8979fdc4456db83cc88103856510 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Tenant-Id: cb0f8979fdc4456db83cc88103856510 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-User: tempest-AttachSCSIVolumeTestJSON-1542709130-project-member Apr 20 10:31:33 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:31:33 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:31:33 user devstack@n-api.service[61647]: X-User-Id: 6e5685756fe74751ad4c4fe85c30c951 Apr 20 10:31:33 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1542709130-project-member Apr 20 10:31:33 user devstack@n-api.service[61647]: method: > Apr 20 10:31:33 user devstack@n-api.service[61647]: exception: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:33 user devstack@n-api.service[61647]: action_args: {'id': 'bf7d300f-b748-446b-97ce-6cae12609e7a'} Apr 20 10:31:33 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:33 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:33 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Returning 404 to user: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:31:33 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-932520f4-b78e-466d-a8ae-9bda072695b9 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a" status: 404 len: 111 microversion: 2.1 time: 0.077511 Apr 20 10:31:33 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:33 2023] GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:31:33 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:33 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-2857f7e8-2d43-4dcd-8468-8c6fa52176ce tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '.version_select at 0x7f122b1ca9e0>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:33 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-2857f7e8-2d43-4dcd-8468-8c6fa52176ce tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802426226" status: 202 len: 0 microversion: 2.1 time: 0.044655 Apr 20 10:31:33 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 51/155] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 10:31:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1802426226 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:34 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] HTTP exception thrown: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Request method failure captured: Apr 20 10:31:34 user devstack@n-api.service[61649]: request: DELETE /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a HTTP/1.1 Apr 20 10:31:34 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:31:34 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:31:34 user devstack@n-api.service[61649]: Connection: close Apr 20 10:31:34 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:31:34 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:31:34 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:31:34 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:31:34 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRO928thBXTmf9dE0dLFT2Uai3m5liNw-MfjuZ-cNKGSXdQCFFPMVJ5d9xb4syGwkDUwDcN-CvwokB_Ts4uNljF2yzEXi-66yxaYSODVPsIIRAw2aI8IViM2SpVC19hqBVbQmHDgPBvC1OYpokZmrMcIyA4cCH8eUgwhySZ86tDtVh4 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Project-Id: cb0f8979fdc4456db83cc88103856510 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Tenant-Id: cb0f8979fdc4456db83cc88103856510 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-User: tempest-AttachSCSIVolumeTestJSON-1542709130-project-member Apr 20 10:31:34 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:31:34 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:31:34 user devstack@n-api.service[61649]: X-User-Id: 6e5685756fe74751ad4c4fe85c30c951 Apr 20 10:31:34 user devstack@n-api.service[61649]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1542709130-project-member Apr 20 10:31:34 user devstack@n-api.service[61649]: method: > Apr 20 10:31:34 user devstack@n-api.service[61649]: exception: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61649]: action_args: {'id': 'bf7d300f-b748-446b-97ce-6cae12609e7a'} Apr 20 10:31:34 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Returning 404 to user: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:31:34 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-79ff868a-8f85-4986-b8ec-f9e7c382e947 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a" status: 404 len: 111 microversion: 2.1 time: 0.040010 Apr 20 10:31:34 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 54/156] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:31:34 2023] DELETE /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] [instance: bf7d300f-b748-446b-97ce-6cae12609e7a] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:34 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] HTTP exception thrown: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Request method failure captured: Apr 20 10:31:34 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a HTTP/1.1 Apr 20 10:31:34 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:31:34 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:31:34 user devstack@n-api.service[61647]: Connection: close Apr 20 10:31:34 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:31:34 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:31:34 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:31:34 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:31:34 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRO928thBXTmf9dE0dLFT2Uai3m5liNw-MfjuZ-cNKGSXdQCFFPMVJ5d9xb4syGwkDUwDcN-CvwokB_Ts4uNljF2yzEXi-66yxaYSODVPsIIRAw2aI8IViM2SpVC19hqBVbQmHDgPBvC1OYpokZmrMcIyA4cCH8eUgwhySZ86tDtVh4 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Project-Id: cb0f8979fdc4456db83cc88103856510 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb0f8979fdc4456db83cc88103856510"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Tenant-Id: cb0f8979fdc4456db83cc88103856510 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1542709130 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-User: tempest-AttachSCSIVolumeTestJSON-1542709130-project-member Apr 20 10:31:34 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:31:34 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:31:34 user devstack@n-api.service[61647]: X-User-Id: 6e5685756fe74751ad4c4fe85c30c951 Apr 20 10:31:34 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1542709130-project-member Apr 20 10:31:34 user devstack@n-api.service[61647]: method: > Apr 20 10:31:34 user devstack@n-api.service[61647]: exception: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61647]: action_args: {'id': 'bf7d300f-b748-446b-97ce-6cae12609e7a'} Apr 20 10:31:34 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. Apr 20 10:31:34 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:31:34 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] Returning 404 to user: Instance bf7d300f-b748-446b-97ce-6cae12609e7a could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:31:34 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-20aede1a-7f70-4577-bf2b-d3f23e09b497 tempest-AttachSCSIVolumeTestJSON-1542709130 tempest-AttachSCSIVolumeTestJSON-1542709130-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a" status: 404 len: 111 microversion: 2.1 time: 0.027989 Apr 20 10:31:34 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:34 2023] GET /compute/v2.1/servers/bf7d300f-b748-446b-97ce-6cae12609e7a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 10:31:38 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:38 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-ad2f1581-5ede-4303-b1cf-48b30b93c4bf tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Action: 'create', calling method: .version_select at 0x7f122b2e7370>, body: {"keypair": {"name": "tempest-keypair-859145494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+9jK7t3ClieA+FSlSLflLYtwuLOAFMxwNPVMQvmnWXsj1kwhJZoZbs5/2/0cGkEuG79cH7XZnatiE6eDZhPpV+eOa2IU0p9RSwsraobttdhAQWALDgd6b3pAqIqOw/YA=="}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:38 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-ad2f1581-5ede-4303-b1cf-48b30b93c4bf tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for project 12e621999b00481c839affc4e83ce37c. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:31:38 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-ad2f1581-5ede-4303-b1cf-48b30b93c4bf tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for user 2a04be58cd354d508616edd9d5eeff54 and project 12e621999b00481c839affc4e83ce37c. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:31:38 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-ad2f1581-5ede-4303-b1cf-48b30b93c4bf tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161727 Apr 20 10:31:38 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 52/158] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:31:38 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:40 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1210707222", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "51b24d7b-a37b-453a-a335-3ba809f26953"}], "security_groups": [{"name": "tempest-securitygroup--2036776141"}], "key_name": "tempest-keypair-859145494", "user_data": "}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:40 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] validate_networks() for [('51b24d7b-a37b-453a-a335-3ba809f26953', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:31:40 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:31:40 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:31:40 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:31:40 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:31:40 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for project 12e621999b00481c839affc4e83ce37c. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for user 2a04be58cd354d508616edd9d5eeff54 and project 12e621999b00481c839affc4e83ce37c. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:31:41 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:31:41 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-127ac422-29a9-4056-8c18-5a36adcaab5d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.656206 Apr 20 10:31:41 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 55/159] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:31:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:31:41 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-51971f98-06e3-4359-9eb9-b74a05486443 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:41 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-51971f98-06e3-4359-9eb9-b74a05486443 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:41 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-51971f98-06e3-4359-9eb9-b74a05486443 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:41 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-51971f98-06e3-4359-9eb9-b74a05486443 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8" status: 200 len: 1235 microversion: 2.1 time: 0.140086 Apr 20 10:31:41 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 53/160] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:41 2023] GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 => generated 1235 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:43 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-03c01caa-cdba-4bc2-a2f9-a2635a756776 req-592034d8-11f7-4a49-8e5d-3f512612c772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319eafd3-e6ac-4fcc-92b1-a5f4e60952e8", "tag": "f6cef929-1703-4207-bef4-18cfa6e9f6fc"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:43 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-03c01caa-cdba-4bc2-a2f9-a2635a756776 req-592034d8-11f7-4a49-8e5d-3f512612c772 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-03c01caa-cdba-4bc2-a2f9-a2635a756776 req-592034d8-11f7-4a49-8e5d-3f512612c772 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-03c01caa-cdba-4bc2-a2f9-a2635a756776 req-592034d8-11f7-4a49-8e5d-3f512612c772 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:43 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-03c01caa-cdba-4bc2-a2f9-a2635a756776 req-592034d8-11f7-4a49-8e5d-3f512612c772 service nova] Creating event network-changed:f6cef929-1703-4207-bef4-18cfa6e9f6fc for instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 on user Apr 20 10:31:43 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-03c01caa-cdba-4bc2-a2f9-a2635a756776 req-592034d8-11f7-4a49-8e5d-3f512612c772 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046003 Apr 20 10:31:43 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:46 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-496770b2-5f09-4b50-89da-df7738a2e488 req-54a27cd3-2e45-45f4-9c5b-73c59af739ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319eafd3-e6ac-4fcc-92b1-a5f4e60952e8", "name": "network-vif-plugged", "status": "completed", "tag": "f6cef929-1703-4207-bef4-18cfa6e9f6fc"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-496770b2-5f09-4b50-89da-df7738a2e488 req-54a27cd3-2e45-45f4-9c5b-73c59af739ca service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-496770b2-5f09-4b50-89da-df7738a2e488 req-54a27cd3-2e45-45f4-9c5b-73c59af739ca service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-496770b2-5f09-4b50-89da-df7738a2e488 req-54a27cd3-2e45-45f4-9c5b-73c59af739ca service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:46 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-496770b2-5f09-4b50-89da-df7738a2e488 req-54a27cd3-2e45-45f4-9c5b-73c59af739ca service nova] Creating event network-vif-plugged:f6cef929-1703-4207-bef4-18cfa6e9f6fc for instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 on user Apr 20 10:31:46 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-496770b2-5f09-4b50-89da-df7738a2e488 req-54a27cd3-2e45-45f4-9c5b-73c59af739ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029327 Apr 20 10:31:46 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 56/162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:48 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-ac6c1229-5c03-447b-b6fc-79aad4b5bec1 req-149e6291-f242-42cb-9d08-4a69e5e41e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319eafd3-e6ac-4fcc-92b1-a5f4e60952e8", "name": "network-vif-plugged", "status": "completed", "tag": "f6cef929-1703-4207-bef4-18cfa6e9f6fc"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:48 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-ac6c1229-5c03-447b-b6fc-79aad4b5bec1 req-149e6291-f242-42cb-9d08-4a69e5e41e7b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-ac6c1229-5c03-447b-b6fc-79aad4b5bec1 req-149e6291-f242-42cb-9d08-4a69e5e41e7b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-ac6c1229-5c03-447b-b6fc-79aad4b5bec1 req-149e6291-f242-42cb-9d08-4a69e5e41e7b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:48 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-ac6c1229-5c03-447b-b6fc-79aad4b5bec1 req-149e6291-f242-42cb-9d08-4a69e5e41e7b service nova] Creating event network-vif-plugged:f6cef929-1703-4207-bef4-18cfa6e9f6fc for instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 on user Apr 20 10:31:48 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-ac6c1229-5c03-447b-b6fc-79aad4b5bec1 req-149e6291-f242-42cb-9d08-4a69e5e41e7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030206 Apr 20 10:31:48 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 10:31:50 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:50 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1901028417", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:50 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] validate_networks() for [('ae2c97fe-5f89-4830-9303-439b5956dc16', None, None, None, None, None)] {{(pid=61648) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Flavor limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Image limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Flavor pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Image pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Getting quotas for project d6d8880a9263444cba94725a83974403. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Getting quotas for user 729f2fdafa8e471e8f0de0c8323c36b5 and project d6d8880a9263444cba94725a83974403. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Going to run 1 instances... {{(pid=61648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:31:51 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: e1115ad2-b858-4859-b1bb-2175f7eab867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:31:51 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-7bb71586-a39a-4b0f-907b-9989767a6845 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.972105 Apr 20 10:31:51 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 54/164] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:31:50 2023] POST /compute/v2.1/servers => generated 381 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:31:51 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:51 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:51 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f118aa8e-ac0d-4874-8652-3a3020258412 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:51 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-f118aa8e-ac0d-4874-8652-3a3020258412 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: e1115ad2-b858-4859-b1bb-2175f7eab867] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:51 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-f118aa8e-ac0d-4874-8652-3a3020258412 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:51 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f118aa8e-ac0d-4874-8652-3a3020258412 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867" status: 200 len: 1216 microversion: 2.1 time: 0.070376 Apr 20 10:31:51 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 57/165] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:51 2023] GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:51 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:31:51 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-325022623", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:51 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] validate_networks() for [('ae2c97fe-5f89-4830-9303-439b5956dc16', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Getting quotas for project d6d8880a9263444cba94725a83974403. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Getting quotas for user 729f2fdafa8e471e8f0de0c8323c36b5 and project d6d8880a9263444cba94725a83974403. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:31:52 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:31:52 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-653c649f-97ce-4e46-8952-2c0870fffaed tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.719118 Apr 20 10:31:52 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 55/166] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:31:51 2023] POST /compute/v2.1/servers => generated 381 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:31:52 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-dd2db842-cfa2-42ab-bf90-720647d0c1c5 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:52 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-dd2db842-cfa2-42ab-bf90-720647d0c1c5 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:52 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-dd2db842-cfa2-42ab-bf90-720647d0c1c5 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:31:52 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-dd2db842-cfa2-42ab-bf90-720647d0c1c5 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a" status: 200 len: 1215 microversion: 2.1 time: 0.076867 Apr 20 10:31:52 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:52 2023] GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] [instance: 23940921-698b-4e96-8aed-2d1c8c12299f] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:52 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] HTTP exception thrown: Instance 23940921-698b-4e96-8aed-2d1c8c12299f could not be found. Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Request method failure captured: Apr 20 10:31:52 user devstack@n-api.service[61649]: request: GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f HTTP/1.1 Apr 20 10:31:52 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:31:52 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:31:52 user devstack@n-api.service[61649]: Connection: close Apr 20 10:31:52 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:31:52 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:31:52 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:31:52 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:31:52 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRPz1qkug4VFnsmh-wTZ-gEjOw2Q49AQOmzIaHO27PuDBVoUa2aa6kRzDxebpElbSALZLoTKbPG_LLb2LCADzntIxrY18iezZmIEc6MdQDu50mPhHxjL-rsWArR7VnYRoAkvG31J3wKxU33Efu12nUd61ZBmtfsz0uw6wkokke6OTJg Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Project-Id: 3d65a1127ac04ac8976d9fbb08197248 Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Project-Name: tempest-VolumesActionsTest-640305762 Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d65a1127ac04ac8976d9fbb08197248"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d65a1127ac04ac8976d9fbb08197248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3d65a1127ac04ac8976d9fbb08197248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Tenant: tempest-VolumesActionsTest-640305762 Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Tenant-Id: 3d65a1127ac04ac8976d9fbb08197248 Apr 20 10:31:52 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-VolumesActionsTest-640305762 Apr 20 10:31:52 user devstack@n-api.service[61649]: X-User: tempest-VolumesActionsTest-640305762-project-member Apr 20 10:31:52 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:31:52 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:31:52 user devstack@n-api.service[61649]: X-User-Id: 8355ed1609024bc1a30cbc422d8f90c2 Apr 20 10:31:52 user devstack@n-api.service[61649]: X-User-Name: tempest-VolumesActionsTest-640305762-project-member Apr 20 10:31:52 user devstack@n-api.service[61649]: method: > Apr 20 10:31:52 user devstack@n-api.service[61649]: exception: Instance 23940921-698b-4e96-8aed-2d1c8c12299f could not be found. Apr 20 10:31:52 user devstack@n-api.service[61649]: action_args: {'id': '23940921-698b-4e96-8aed-2d1c8c12299f'} Apr 20 10:31:52 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23940921-698b-4e96-8aed-2d1c8c12299f could not be found. Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23940921-698b-4e96-8aed-2d1c8c12299f could not be found. Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23940921-698b-4e96-8aed-2d1c8c12299f could not be found. Apr 20 10:31:52 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:31:52 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] Returning 404 to user: Instance 23940921-698b-4e96-8aed-2d1c8c12299f could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:31:52 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-8a8a1083-c2e0-4b49-97b1-31be0155f1dc tempest-VolumesActionsTest-640305762 tempest-VolumesActionsTest-640305762-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f" status: 404 len: 111 microversion: 2.1 time: 0.035089 Apr 20 10:31:52 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 58/168] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:31:52 2023] GET /compute/v2.1/servers/23940921-698b-4e96-8aed-2d1c8c12299f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:31:53 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-f6d1ec62-e29d-47a3-8eca-20c161eb9848 req-450c5071-a922-4d16-a502-67787f410125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1115ad2-b858-4859-b1bb-2175f7eab867", "tag": "c47ac25a-c0d0-4443-8759-c573281b63f9"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f6d1ec62-e29d-47a3-8eca-20c161eb9848 req-450c5071-a922-4d16-a502-67787f410125 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f6d1ec62-e29d-47a3-8eca-20c161eb9848 req-450c5071-a922-4d16-a502-67787f410125 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f6d1ec62-e29d-47a3-8eca-20c161eb9848 req-450c5071-a922-4d16-a502-67787f410125 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:53 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-f6d1ec62-e29d-47a3-8eca-20c161eb9848 req-450c5071-a922-4d16-a502-67787f410125 service nova] Creating event network-changed:c47ac25a-c0d0-4443-8759-c573281b63f9 for instance e1115ad2-b858-4859-b1bb-2175f7eab867 on user Apr 20 10:31:53 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-f6d1ec62-e29d-47a3-8eca-20c161eb9848 req-450c5071-a922-4d16-a502-67787f410125 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034709 Apr 20 10:31:53 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:54 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-4bd1090f-a122-44c6-9032-ca4ce1294dc5 req-41d0aa64-54ba-4f84-b960-272f0982dfd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:54 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4bd1090f-a122-44c6-9032-ca4ce1294dc5 req-41d0aa64-54ba-4f84-b960-272f0982dfd9 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:54 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4bd1090f-a122-44c6-9032-ca4ce1294dc5 req-41d0aa64-54ba-4f84-b960-272f0982dfd9 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:54 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4bd1090f-a122-44c6-9032-ca4ce1294dc5 req-41d0aa64-54ba-4f84-b960-272f0982dfd9 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:54 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-4bd1090f-a122-44c6-9032-ca4ce1294dc5 req-41d0aa64-54ba-4f84-b960-272f0982dfd9 service nova] Creating event network-changed:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:31:54 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-4bd1090f-a122-44c6-9032-ca4ce1294dc5 req-41d0aa64-54ba-4f84-b960-272f0982dfd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038819 Apr 20 10:31:54 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 56/170] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:57 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-98a2a1db-7934-41d0-a382-1c969950d35e req-0ce1c515-465a-4de2-b80f-1b627e8cab6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1115ad2-b858-4859-b1bb-2175f7eab867", "name": "network-vif-plugged", "status": "completed", "tag": "c47ac25a-c0d0-4443-8759-c573281b63f9"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:57 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-98a2a1db-7934-41d0-a382-1c969950d35e req-0ce1c515-465a-4de2-b80f-1b627e8cab6f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:57 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-98a2a1db-7934-41d0-a382-1c969950d35e req-0ce1c515-465a-4de2-b80f-1b627e8cab6f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:57 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-98a2a1db-7934-41d0-a382-1c969950d35e req-0ce1c515-465a-4de2-b80f-1b627e8cab6f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:57 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-98a2a1db-7934-41d0-a382-1c969950d35e req-0ce1c515-465a-4de2-b80f-1b627e8cab6f service nova] Creating event network-vif-plugged:c47ac25a-c0d0-4443-8759-c573281b63f9 for instance e1115ad2-b858-4859-b1bb-2175f7eab867 on user Apr 20 10:31:57 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-98a2a1db-7934-41d0-a382-1c969950d35e req-0ce1c515-465a-4de2-b80f-1b627e8cab6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041880 Apr 20 10:31:57 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 59/171] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:31:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1115ad2-b858-4859-b1bb-2175f7eab867", "name": "network-vif-plugged", "status": "completed", "tag": "c47ac25a-c0d0-4443-8759-c573281b63f9"}, {"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-plugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}, {"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-plugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:31:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:31:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:31:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:31:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] Creating event network-vif-plugged:c47ac25a-c0d0-4443-8759-c573281b63f9 for instance e1115ad2-b858-4859-b1bb-2175f7eab867 on user Apr 20 10:31:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] Creating event network-vif-plugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:31:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] Creating event network-vif-plugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:31:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-bac3e7be-5daa-404c-9a56-a06562b80e1a req-095de349-65b2-42f6-98b8-601dc8e2398d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050807 Apr 20 10:31:59 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 57/172] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:31:59 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=8 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:07 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:08 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67955d2e81c04b8d8dbcbe577303e025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4a2af680394ec889b4661753658b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:32:08 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-fd52f638-9366-4ed2-94a2-73699bfd0357 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af" status: 200 len: 1536 microversion: 2.1 time: 0.421567 Apr 20 10:32:08 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:07 2023] GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af => generated 1536 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=9 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:12 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aef9efd33b946709d8f01f41b79f382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1545b79af0497497e960cbd68aa8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:32:12 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-0658dc10-83ed-4f8b-ac6e-202412ed2a7c tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70" status: 200 len: 1672 microversion: 2.1 time: 0.491470 Apr 20 10:32:12 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 60/174] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:11 2023] GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 => generated 1672 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 10:32:13 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:13 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:13 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:13 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=8 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-e4feceee-9c57-45b1-9e41-f1880f38867d tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '.version_select at 0x7f122a63b250>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-e4feceee-9c57-45b1-9e41-f1880f38867d tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445" status: 204 len: 0 microversion: 2.1 time: 0.259645 Apr 20 10:32:13 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:13 2023] DELETE /compute/v2.1/images/5b0ba2e0-a8e5-42fb-8f5f-33bbf1aab445 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:13 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:32:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-4152143d-a0bf-46d4-a021-846818ab0d82 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70" status: 204 len: 0 microversion: 2.1 time: 0.112352 Apr 20 10:32:13 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:32:13 2023] DELETE /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:14 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aef9efd33b946709d8f01f41b79f382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d1545b79af0497497e960cbd68aa8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:32:14 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-66160b12-130d-48d2-84e0-916deced76ff tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70" status: 200 len: 1678 microversion: 2.1 time: 0.161871 Apr 20 10:32:14 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 61/177] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:13 2023] GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:32:14 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-cfaf1dd7-33a6-4992-b8f2-3902b027f201 req-93964508-4bb8-451c-8867-b821f40c7d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48e6aa1-dd33-42a4-89c9-20691b628c70", "name": "network-vif-unplugged", "status": "completed", "tag": "0954983e-5cb4-4486-9816-67f4f5f78b35"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:32:14 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-cfaf1dd7-33a6-4992-b8f2-3902b027f201 req-93964508-4bb8-451c-8867-b821f40c7d5f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:14 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-cfaf1dd7-33a6-4992-b8f2-3902b027f201 req-93964508-4bb8-451c-8867-b821f40c7d5f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:14 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-cfaf1dd7-33a6-4992-b8f2-3902b027f201 req-93964508-4bb8-451c-8867-b821f40c7d5f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:14 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-cfaf1dd7-33a6-4992-b8f2-3902b027f201 req-93964508-4bb8-451c-8867-b821f40c7d5f service nova] Creating event network-vif-unplugged:0954983e-5cb4-4486-9816-67f4f5f78b35 for instance f48e6aa1-dd33-42a4-89c9-20691b628c70 on user Apr 20 10:32:14 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-cfaf1dd7-33a6-4992-b8f2-3902b027f201 req-93964508-4bb8-451c-8867-b821f40c7d5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032920 Apr 20 10:32:14 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 59/178] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:14 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:32:14 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-5eb6715c-99d9-4b12-a842-dbb8ead28d5e tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.245111 Apr 20 10:32:14 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 59/179] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:14 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:32:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-40292338-af2e-4fab-a540-36eeacc7c8d9 req-b39fd3b9-de42-4be8-928b-e0c5d2e53745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48e6aa1-dd33-42a4-89c9-20691b628c70", "name": "network-vif-deleted", "tag": "0954983e-5cb4-4486-9816-67f4f5f78b35"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:32:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-40292338-af2e-4fab-a540-36eeacc7c8d9 req-b39fd3b9-de42-4be8-928b-e0c5d2e53745 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-40292338-af2e-4fab-a540-36eeacc7c8d9 req-b39fd3b9-de42-4be8-928b-e0c5d2e53745 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-40292338-af2e-4fab-a540-36eeacc7c8d9 req-b39fd3b9-de42-4be8-928b-e0c5d2e53745 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-40292338-af2e-4fab-a540-36eeacc7c8d9 req-b39fd3b9-de42-4be8-928b-e0c5d2e53745 service nova] Creating event network-vif-deleted:0954983e-5cb4-4486-9816-67f4f5f78b35 for instance f48e6aa1-dd33-42a4-89c9-20691b628c70 on user Apr 20 10:32:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-40292338-af2e-4fab-a540-36eeacc7c8d9 req-b39fd3b9-de42-4be8-928b-e0c5d2e53745 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Apr 20 10:32:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 62/180] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:32:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:32:16 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-59db6c53-a6da-4d8a-8f46-0f3cd8bb4da4 req-c47138a3-3d30-49d6-bbba-eff603bc7836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48e6aa1-dd33-42a4-89c9-20691b628c70", "name": "network-vif-plugged", "status": "completed", "tag": "0954983e-5cb4-4486-9816-67f4f5f78b35"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:32:16 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-59db6c53-a6da-4d8a-8f46-0f3cd8bb4da4 req-c47138a3-3d30-49d6-bbba-eff603bc7836 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:16 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-59db6c53-a6da-4d8a-8f46-0f3cd8bb4da4 req-c47138a3-3d30-49d6-bbba-eff603bc7836 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:16 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-59db6c53-a6da-4d8a-8f46-0f3cd8bb4da4 req-c47138a3-3d30-49d6-bbba-eff603bc7836 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:16 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-59db6c53-a6da-4d8a-8f46-0f3cd8bb4da4 req-c47138a3-3d30-49d6-bbba-eff603bc7836 service nova] Creating event network-vif-plugged:0954983e-5cb4-4486-9816-67f4f5f78b35 for instance f48e6aa1-dd33-42a4-89c9-20691b628c70 on user Apr 20 10:32:16 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-59db6c53-a6da-4d8a-8f46-0f3cd8bb4da4 req-c47138a3-3d30-49d6-bbba-eff603bc7836 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035338 Apr 20 10:32:16 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 60/181] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:32:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: db38a0ab-0165-480d-bddb-cab50bcd22e4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:19 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: db38a0ab-0165-480d-bddb-cab50bcd22e4] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:32:20 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-e455f7fb-1464-41f0-875a-95e103abdf70 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4" status: 204 len: 0 microversion: 2.1 time: 0.158031 Apr 20 10:32:20 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:32:19 2023] DELETE /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: db38a0ab-0165-480d-bddb-cab50bcd22e4] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:20 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-c3058e44-7c86-40f5-8238-bbc9bce2d30a req-e4d94549-6245-4f1e-a782-bfb6467552c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db38a0ab-0165-480d-bddb-cab50bcd22e4", "name": "network-vif-unplugged", "status": "completed", "tag": "7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:32:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-c3058e44-7c86-40f5-8238-bbc9bce2d30a req-e4d94549-6245-4f1e-a782-bfb6467552c7 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-c3058e44-7c86-40f5-8238-bbc9bce2d30a req-e4d94549-6245-4f1e-a782-bfb6467552c7 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-c3058e44-7c86-40f5-8238-bbc9bce2d30a req-e4d94549-6245-4f1e-a782-bfb6467552c7 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:20 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-c3058e44-7c86-40f5-8238-bbc9bce2d30a req-e4d94549-6245-4f1e-a782-bfb6467552c7 service nova] Creating event network-vif-unplugged:7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee for instance db38a0ab-0165-480d-bddb-cab50bcd22e4 on user Apr 20 10:32:20 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-c3058e44-7c86-40f5-8238-bbc9bce2d30a req-e4d94549-6245-4f1e-a782-bfb6467552c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038738 Apr 20 10:32:20 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 61/183] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:32:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:32:20 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712be6d6876f4b2c9d796e406a43f8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ecc1463ec42eea56f2890b032ef7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:32:20 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-32f333fc-bcc0-4a1d-9968-30735681dd6f tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4" status: 200 len: 1502 microversion: 2.1 time: 0.632378 Apr 20 10:32:20 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 63/184] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:20 2023] GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4 => generated 1502 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:32:21 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-6392a502-579d-4365-bdfc-24877462d17b tempest-TestShelveInstance-1436033123 tempest-TestShelveInstance-1436033123-project-member] Action: 'create', calling method: .version_select at 0x7f122b27e170>, body: {"keypair": {"name": "tempest-TestShelveInstance-298744614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMbWXIBT8lnezUVZ24hEHrBmhZNkKzqrWBz1glErBkT2U80uPLf/H8bhxWmAg6cHfVMJaqRiyfoPQW1duLVG+VNZv9F2J906lsB89vqxtNyd6f+cb9xMIgxYSn1OG52rw=="}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:32:21 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-6392a502-579d-4365-bdfc-24877462d17b tempest-TestShelveInstance-1436033123 tempest-TestShelveInstance-1436033123-project-member] Getting quotas for project a3ac1e4ef304472cba1faa176bdb2c63. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:32:21 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-6392a502-579d-4365-bdfc-24877462d17b tempest-TestShelveInstance-1436033123 tempest-TestShelveInstance-1436033123-project-member] Getting quotas for user eff2d09e6d3441ef85f46203856a6839 and project a3ac1e4ef304472cba1faa176bdb2c63. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:32:21 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-6392a502-579d-4365-bdfc-24877462d17b tempest-TestShelveInstance-1436033123 tempest-TestShelveInstance-1436033123-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.363215 Apr 20 10:32:21 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 61/185] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:32:21 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:32:22 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-83711cf6-698c-494d-91db-4b9851ce9d5a req-e9f72315-aaea-4bff-94d6-379e44c2465c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db38a0ab-0165-480d-bddb-cab50bcd22e4", "name": "network-vif-plugged", "status": "completed", "tag": "7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee"}, {"server_uuid": "db38a0ab-0165-480d-bddb-cab50bcd22e4", "name": "network-vif-deleted", "tag": "7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:32:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-83711cf6-698c-494d-91db-4b9851ce9d5a req-e9f72315-aaea-4bff-94d6-379e44c2465c service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-83711cf6-698c-494d-91db-4b9851ce9d5a req-e9f72315-aaea-4bff-94d6-379e44c2465c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:22 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-83711cf6-698c-494d-91db-4b9851ce9d5a req-e9f72315-aaea-4bff-94d6-379e44c2465c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:22 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-83711cf6-698c-494d-91db-4b9851ce9d5a req-e9f72315-aaea-4bff-94d6-379e44c2465c service nova] Creating event network-vif-plugged:7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee for instance db38a0ab-0165-480d-bddb-cab50bcd22e4 on user Apr 20 10:32:22 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-83711cf6-698c-494d-91db-4b9851ce9d5a req-e9f72315-aaea-4bff-94d6-379e44c2465c service nova] Creating event network-vif-deleted:7d16f167-ea3c-4ac0-b8a1-2f4616bef2ee for instance db38a0ab-0165-480d-bddb-cab50bcd22e4 on user Apr 20 10:32:22 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-83711cf6-698c-494d-91db-4b9851ce9d5a req-e9f72315-aaea-4bff-94d6-379e44c2465c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029762 Apr 20 10:32:22 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 62/186] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:32:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:32:24 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f493e327-67cc-4bdd-991d-26518539ccb6 tempest-TestShelveInstance-1436033123 tempest-TestShelveInstance-1436033123-project-member] Calling method '.version_select at 0x7f122a623eb0>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:24 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f493e327-67cc-4bdd-991d-26518539ccb6 tempest-TestShelveInstance-1436033123 tempest-TestShelveInstance-1436033123-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-298744614" status: 202 len: 0 microversion: 2.1 time: 0.026505 Apr 20 10:32:24 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 64/187] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 20 10:32:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-298744614 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:31 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:32:31 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-3002f954-33f9-49d8-812a-391311be1631 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8" status: 200 len: 1545 microversion: 2.1 time: 0.275636 Apr 20 10:32:31 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 62/188] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:31 2023] GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 => generated 1545 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=8 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=8 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:32:42 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:32:42 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-c68bf660-1be4-4eed-852e-a5b2e50e3ef4 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a" status: 200 len: 1504 microversion: 2.1 time: 0.292884 Apr 20 10:32:42 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:32:42 2023] GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:32:48 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=20 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:48 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:48 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-8831c249-5ccf-4403-8eec-98edfec23ab6 tempest-TestVolumeBootPattern-406982028 tempest-TestVolumeBootPattern-406982028-project-member] Action: 'create', calling method: .version_select at 0x7f122a6997e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-145410284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3cjtVuh5CSyskSLlM7wehflwTTaFS+neFxixeAvJ+P9POfb9O36foK/mkpgEeW26g57n8moxvDHuE39roWoFyjeJvs0xfXmFT2uBt16yQCn3WJKnhH0wtIfbcbtk1eKQ=="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:32:48 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-8831c249-5ccf-4403-8eec-98edfec23ab6 tempest-TestVolumeBootPattern-406982028 tempest-TestVolumeBootPattern-406982028-project-member] Getting quotas for project 681dd9cdc82d41cbb5ce16bfde7e5416. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:32:48 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-8831c249-5ccf-4403-8eec-98edfec23ab6 tempest-TestVolumeBootPattern-406982028 tempest-TestVolumeBootPattern-406982028-project-member] Getting quotas for user 5176c0932371497cae260e45dc67499b and project 681dd9cdc82d41cbb5ce16bfde7e5416. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:32:48 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-8831c249-5ccf-4403-8eec-98edfec23ab6 tempest-TestVolumeBootPattern-406982028 tempest-TestVolumeBootPattern-406982028-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.050958 Apr 20 10:32:48 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 65/190] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:32:48 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 10:32:51 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-adf9c2b0-920b-4acc-8b57-afde82347707 tempest-TestVolumeBootPattern-406982028 tempest-TestVolumeBootPattern-406982028-project-member] Calling method '.version_select at 0x7f122a8843a0>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:32:51 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:51 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:32:51 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-adf9c2b0-920b-4acc-8b57-afde82347707 tempest-TestVolumeBootPattern-406982028 tempest-TestVolumeBootPattern-406982028-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-145410284" status: 202 len: 0 microversion: 2.1 time: 0.035197 Apr 20 10:32:51 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1337 bytes} [Thu Apr 20 10:32:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-145410284 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] [instance: f48e6aa1-dd33-42a4-89c9-20691b628c70] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:04 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] HTTP exception thrown: Instance f48e6aa1-dd33-42a4-89c9-20691b628c70 could not be found. Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Request method failure captured: Apr 20 10:33:04 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 HTTP/1.1 Apr 20 10:33:04 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:33:04 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:33:04 user devstack@n-api.service[61647]: Connection: close Apr 20 10:33:04 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:33:04 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:33:04 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:33:04 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:33:04 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRPCIm5sqy4tnVYRqBpWw0UVus39VS1ABNe7-r5_28WU1EizBwM5PSjrpF5zhOFy8pBKsmopwkg5u0VJ8nT7Tv8K3IwaWQNEtJE2lawO70c-qfJU8VY5Q95Nbjphbu-RHxT9ismiYFGYqcxzVb3_L_Cl0tUBtflebkSv5aNLeBwZBDw Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Project-Id: 2d1545b79af0497497e960cbd68aa8f2 Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1071968675 Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d1545b79af0497497e960cbd68aa8f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2d1545b79af0497497e960cbd68aa8f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2d1545b79af0497497e960cbd68aa8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Tenant: tempest-ServerStableDeviceRescueTest-1071968675 Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Tenant-Id: 2d1545b79af0497497e960cbd68aa8f2 Apr 20 10:33:04 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1071968675 Apr 20 10:33:04 user devstack@n-api.service[61647]: X-User: tempest-ServerStableDeviceRescueTest-1071968675-project-member Apr 20 10:33:04 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:33:04 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:33:04 user devstack@n-api.service[61647]: X-User-Id: 2aef9efd33b946709d8f01f41b79f382 Apr 20 10:33:04 user devstack@n-api.service[61647]: X-User-Name: tempest-ServerStableDeviceRescueTest-1071968675-project-member Apr 20 10:33:04 user devstack@n-api.service[61647]: method: > Apr 20 10:33:04 user devstack@n-api.service[61647]: exception: Instance f48e6aa1-dd33-42a4-89c9-20691b628c70 could not be found. Apr 20 10:33:04 user devstack@n-api.service[61647]: action_args: {'id': 'f48e6aa1-dd33-42a4-89c9-20691b628c70'} Apr 20 10:33:04 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48e6aa1-dd33-42a4-89c9-20691b628c70 could not be found. Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48e6aa1-dd33-42a4-89c9-20691b628c70 could not be found. Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48e6aa1-dd33-42a4-89c9-20691b628c70 could not be found. Apr 20 10:33:04 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:33:04 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Returning 404 to user: Instance f48e6aa1-dd33-42a4-89c9-20691b628c70 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:33:04 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-05ccf8b7-de86-442c-9e6e-94cfee7ef955 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70" status: 404 len: 111 microversion: 2.1 time: 0.105563 Apr 20 10:33:04 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:04 2023] GET /compute/v2.1/servers/f48e6aa1-dd33-42a4-89c9-20691b628c70 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:33:04 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:04 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:04 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-8cf7457f-5964-4359-af0d-5570241d6f04 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] Calling method '.version_select at 0x7f122a949ab0>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:04 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-8cf7457f-5964-4359-af0d-5570241d6f04 tempest-ServerStableDeviceRescueTest-1071968675 tempest-ServerStableDeviceRescueTest-1071968675-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314135284" status: 202 len: 0 microversion: 2.1 time: 0.025299 Apr 20 10:33:04 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 10:33:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314135284 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:08 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-4508070d-6f1e-4955-9926-6ae4a0ff3e7b tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.339890 Apr 20 10:33:08 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:33:08 2023] GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af/os-interface => generated 283 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:09 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-80b280af-31d7-4c11-8c15-77bda9d5eb91 req-8d468b19-1cca-44c1-a66e-53b86a7def57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af", "tag": "3a9efede-078b-4adc-9b72-465253f4444d"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:09 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-80b280af-31d7-4c11-8c15-77bda9d5eb91 req-8d468b19-1cca-44c1-a66e-53b86a7def57 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:09 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-80b280af-31d7-4c11-8c15-77bda9d5eb91 req-8d468b19-1cca-44c1-a66e-53b86a7def57 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:09 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-80b280af-31d7-4c11-8c15-77bda9d5eb91 req-8d468b19-1cca-44c1-a66e-53b86a7def57 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:09 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-80b280af-31d7-4c11-8c15-77bda9d5eb91 req-8d468b19-1cca-44c1-a66e-53b86a7def57 service nova] Creating event network-changed:3a9efede-078b-4adc-9b72-465253f4444d for instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af on user Apr 20 10:33:09 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-80b280af-31d7-4c11-8c15-77bda9d5eb91 req-8d468b19-1cca-44c1-a66e-53b86a7def57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041601 Apr 20 10:33:09 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 65/195] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:09 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-3fb3fc76-c287-4406-b5fa-383c7953049a tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af/ips" status: 200 len: 104 microversion: 2.1 time: 0.040654 Apr 20 10:33:09 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:33:09 2023] GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af/ips => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: db38a0ab-0165-480d-bddb-cab50bcd22e4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:10 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] HTTP exception thrown: Instance db38a0ab-0165-480d-bddb-cab50bcd22e4 could not be found. Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Request method failure captured: Apr 20 10:33:10 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4 HTTP/1.1 Apr 20 10:33:10 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:33:10 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:33:10 user devstack@n-api.service[61648]: Connection: close Apr 20 10:33:10 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:33:10 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:33:10 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:33:10 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:33:10 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRO9uxZ_j4TYX2wETQSeg9BCBKLVEfWQnqVapOjvr-063hM4ysONBwM-7gpO-h1PQXG52s_0MyAo9kxG2czl9bOltnWRZ9qrsZmfcQjDeoOijcrbA8d4ZbNP2S6EjVBYFcZ0FowBQbF1GEv6T0CtZWQ091OarCCfvrxziay9BK8jy5U Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Project-Id: 7c3ecc1463ec42eea56f2890b032ef7a Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Project-Name: tempest-VolumesAdminNegativeTest-2134667240 Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c3ecc1463ec42eea56f2890b032ef7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c3ecc1463ec42eea56f2890b032ef7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c3ecc1463ec42eea56f2890b032ef7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Tenant: tempest-VolumesAdminNegativeTest-2134667240 Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Tenant-Id: 7c3ecc1463ec42eea56f2890b032ef7a Apr 20 10:33:10 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2134667240 Apr 20 10:33:10 user devstack@n-api.service[61648]: X-User: tempest-VolumesAdminNegativeTest-2134667240-project-member Apr 20 10:33:10 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:33:10 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:33:10 user devstack@n-api.service[61648]: X-User-Id: 712be6d6876f4b2c9d796e406a43f8bf Apr 20 10:33:10 user devstack@n-api.service[61648]: X-User-Name: tempest-VolumesAdminNegativeTest-2134667240-project-member Apr 20 10:33:10 user devstack@n-api.service[61648]: method: > Apr 20 10:33:10 user devstack@n-api.service[61648]: exception: Instance db38a0ab-0165-480d-bddb-cab50bcd22e4 could not be found. Apr 20 10:33:10 user devstack@n-api.service[61648]: action_args: {'id': 'db38a0ab-0165-480d-bddb-cab50bcd22e4'} Apr 20 10:33:10 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db38a0ab-0165-480d-bddb-cab50bcd22e4 could not be found. Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db38a0ab-0165-480d-bddb-cab50bcd22e4 could not be found. Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db38a0ab-0165-480d-bddb-cab50bcd22e4 could not be found. Apr 20 10:33:10 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:33:10 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Returning 404 to user: Instance db38a0ab-0165-480d-bddb-cab50bcd22e4 could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:33:10 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-fd5295e7-21b8-4797-ae1e-6a2e03bea070 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4" status: 404 len: 111 microversion: 2.1 time: 0.030521 Apr 20 10:33:10 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:10 2023] GET /compute/v2.1/servers/db38a0ab-0165-480d-bddb-cab50bcd22e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Going to try to terminate instance {{(pid=61647) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:33:11 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-065d39c6-0121-4e0c-bd6a-e069ead40780 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466" status: 204 len: 0 microversion: 2.1 time: 0.116720 Apr 20 10:33:11 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 68/198] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:33:10 2023] DELETE /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:33:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-02a2ac9a-bd67-41d0-ad1f-a5e23263c635 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af" status: 204 len: 0 microversion: 2.1 time: 0.126476 Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:11 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:33:10 2023] DELETE /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-9b6dcf8e-8224-4687-a438-6ded9597028d req-c304457a-ded4-4a39-b12b-d87f4b6d2d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af", "name": "network-vif-unplugged", "status": "completed", "tag": "3a9efede-078b-4adc-9b72-465253f4444d"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-9b6dcf8e-8224-4687-a438-6ded9597028d req-c304457a-ded4-4a39-b12b-d87f4b6d2d56 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-9b6dcf8e-8224-4687-a438-6ded9597028d req-c304457a-ded4-4a39-b12b-d87f4b6d2d56 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-9b6dcf8e-8224-4687-a438-6ded9597028d req-c304457a-ded4-4a39-b12b-d87f4b6d2d56 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-9b6dcf8e-8224-4687-a438-6ded9597028d req-c304457a-ded4-4a39-b12b-d87f4b6d2d56 service nova] Creating event network-vif-unplugged:3a9efede-078b-4adc-9b72-465253f4444d for instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af on user Apr 20 10:33:11 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712be6d6876f4b2c9d796e406a43f8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3ecc1463ec42eea56f2890b032ef7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:33:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-9b6dcf8e-8224-4687-a438-6ded9597028d req-c304457a-ded4-4a39-b12b-d87f4b6d2d56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032677 Apr 20 10:33:11 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:11 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-1aa86e26-4ba5-4d52-8a12-dd258fac8e97 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466" status: 200 len: 1667 microversion: 2.1 time: 0.309300 Apr 20 10:33:11 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 66/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:11 2023] GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466 => generated 1667 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:33:11 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67955d2e81c04b8d8dbcbe577303e025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4a2af680394ec889b4661753658b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:33:11 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-aaac96bb-250c-4e88-aa54-b012f7f01b36 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af" status: 200 len: 1659 microversion: 2.1 time: 0.320055 Apr 20 10:33:11 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 69/202] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:11 2023] GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af => generated 1659 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-1f969519-b19f-4d1d-af63-52043a134689 req-4d11873f-03b0-457e-be0d-3dc6d166dfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-unplugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-1f969519-b19f-4d1d-af63-52043a134689 req-4d11873f-03b0-457e-be0d-3dc6d166dfff service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-1f969519-b19f-4d1d-af63-52043a134689 req-4d11873f-03b0-457e-be0d-3dc6d166dfff service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-1f969519-b19f-4d1d-af63-52043a134689 req-4d11873f-03b0-457e-be0d-3dc6d166dfff service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-1f969519-b19f-4d1d-af63-52043a134689 req-4d11873f-03b0-457e-be0d-3dc6d166dfff service nova] Creating event network-vif-unplugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:33:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-1f969519-b19f-4d1d-af63-52043a134689 req-4d11873f-03b0-457e-be0d-3dc6d166dfff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034380 Apr 20 10:33:11 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 68/203] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:13 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-c099b05f-6ae4-4db7-b182-e96f063efbd1 req-564031c2-0cc3-4809-a022-3270d0b54644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-deleted", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-c099b05f-6ae4-4db7-b182-e96f063efbd1 req-564031c2-0cc3-4809-a022-3270d0b54644 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-c099b05f-6ae4-4db7-b182-e96f063efbd1 req-564031c2-0cc3-4809-a022-3270d0b54644 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-c099b05f-6ae4-4db7-b182-e96f063efbd1 req-564031c2-0cc3-4809-a022-3270d0b54644 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-c099b05f-6ae4-4db7-b182-e96f063efbd1 req-564031c2-0cc3-4809-a022-3270d0b54644 service nova] Creating event network-vif-deleted:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:33:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-c099b05f-6ae4-4db7-b182-e96f063efbd1 req-564031c2-0cc3-4809-a022-3270d0b54644 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035893 Apr 20 10:33:13 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 67/204] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:13 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-4d8f6b85-d2e4-43b8-bb93-b1494f925058 req-7914be0e-65df-4afc-88b8-9f4c9e3a2c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af", "name": "network-vif-plugged", "status": "completed", "tag": "3a9efede-078b-4adc-9b72-465253f4444d"}, {"server_uuid": "afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af", "name": "network-vif-deleted", "tag": "3a9efede-078b-4adc-9b72-465253f4444d"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-4d8f6b85-d2e4-43b8-bb93-b1494f925058 req-7914be0e-65df-4afc-88b8-9f4c9e3a2c3d service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-4d8f6b85-d2e4-43b8-bb93-b1494f925058 req-7914be0e-65df-4afc-88b8-9f4c9e3a2c3d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-4d8f6b85-d2e4-43b8-bb93-b1494f925058 req-7914be0e-65df-4afc-88b8-9f4c9e3a2c3d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-4d8f6b85-d2e4-43b8-bb93-b1494f925058 req-7914be0e-65df-4afc-88b8-9f4c9e3a2c3d service nova] Creating event network-vif-plugged:3a9efede-078b-4adc-9b72-465253f4444d for instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af on user Apr 20 10:33:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-4d8f6b85-d2e4-43b8-bb93-b1494f925058 req-7914be0e-65df-4afc-88b8-9f4c9e3a2c3d service nova] Creating event network-vif-deleted:3a9efede-078b-4adc-9b72-465253f4444d for instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af on user Apr 20 10:33:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-4d8f6b85-d2e4-43b8-bb93-b1494f925058 req-7914be0e-65df-4afc-88b8-9f4c9e3a2c3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028954 Apr 20 10:33:13 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-plugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}, {"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-plugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}, {"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-plugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}, {"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-unplugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}, {"server_uuid": "9189f862-2e91-4420-ab64-54375c4f9466", "name": "network-vif-plugged", "status": "completed", "tag": "ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:13 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Creating event network-vif-plugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:33:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Creating event network-vif-plugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:33:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Creating event network-vif-plugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:33:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Creating event network-vif-unplugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:33:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] Creating event network-vif-plugged:ab1a6c29-6d99-4a73-b93f-4c4e3b8871bd for instance 9189f862-2e91-4420-ab64-54375c4f9466 on user Apr 20 10:33:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-0384699a-c801-4c9d-be2c-7f92eaeec546 req-bdec3fc9-d1b8-4924-a62a-c4853d36b63e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034681 Apr 20 10:33:13 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 69/206] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:15 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:33:15 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-9fb34922-b9da-4eb6-acfa-655e4ff9cc8c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.225131 Apr 20 10:33:15 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 68/207] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:15 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:15 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:33:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f3114ade-a93d-4923-9caf-67c993f4bfa4 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.218560 Apr 20 10:33:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 71/208] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:15 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:15 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:33:15 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-f5fbeab7-3812-4f5c-933a-2ea4892e6976 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.148874 Apr 20 10:33:15 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:15 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=10 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=20 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:31 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:31 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-b81e44d0-686d-4c95-88cc-6fed760c239e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.324147 Apr 20 10:33:31 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 69/210] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:33:31 2023] GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8/os-interface => generated 283 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:33 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:33 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:33 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-fbc69bf5-fb3c-48c0-a243-12a0f7f43b9c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8/ips" status: 200 len: 108 microversion: 2.1 time: 0.043435 Apr 20 10:33:33 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 71/211] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:33:33 2023] GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8/ips => generated 108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:33 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-08de60a5-6d8c-4f11-bca4-17e54603dbeb req-0996c050-1193-42bc-a352-a6df24aeec4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319eafd3-e6ac-4fcc-92b1-a5f4e60952e8", "tag": "f6cef929-1703-4207-bef4-18cfa6e9f6fc"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-08de60a5-6d8c-4f11-bca4-17e54603dbeb req-0996c050-1193-42bc-a352-a6df24aeec4f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-08de60a5-6d8c-4f11-bca4-17e54603dbeb req-0996c050-1193-42bc-a352-a6df24aeec4f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-08de60a5-6d8c-4f11-bca4-17e54603dbeb req-0996c050-1193-42bc-a352-a6df24aeec4f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:33 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-08de60a5-6d8c-4f11-bca4-17e54603dbeb req-0996c050-1193-42bc-a352-a6df24aeec4f service nova] Creating event network-changed:f6cef929-1703-4207-bef4-18cfa6e9f6fc for instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 on user Apr 20 10:33:33 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-08de60a5-6d8c-4f11-bca4-17e54603dbeb req-0996c050-1193-42bc-a352-a6df24aeec4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229959 Apr 20 10:33:33 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 72/212] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:34 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:35 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:33:35 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-fcaf0e4c-85d2-4045-ba1e-2511d88972ef tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8" status: 204 len: 0 microversion: 2.1 time: 0.105644 Apr 20 10:33:35 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 70/213] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:33:34 2023] DELETE /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:35 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:33:35 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-54a8e027-a825-406a-a03c-bd8ce91ad8ce tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8" status: 200 len: 1670 microversion: 2.1 time: 0.280148 Apr 20 10:33:35 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 72/214] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:35 2023] GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 => generated 1670 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:33:35 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-e85e3cb1-a244-4822-b8e8-406c4cc0053c req-cbf2c42b-733d-49fa-9000-148f094380bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319eafd3-e6ac-4fcc-92b1-a5f4e60952e8", "name": "network-vif-unplugged", "status": "completed", "tag": "f6cef929-1703-4207-bef4-18cfa6e9f6fc"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e85e3cb1-a244-4822-b8e8-406c4cc0053c req-cbf2c42b-733d-49fa-9000-148f094380bc service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e85e3cb1-a244-4822-b8e8-406c4cc0053c req-cbf2c42b-733d-49fa-9000-148f094380bc service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e85e3cb1-a244-4822-b8e8-406c4cc0053c req-cbf2c42b-733d-49fa-9000-148f094380bc service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-e85e3cb1-a244-4822-b8e8-406c4cc0053c req-cbf2c42b-733d-49fa-9000-148f094380bc service nova] Creating event network-vif-unplugged:f6cef929-1703-4207-bef4-18cfa6e9f6fc for instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 on user Apr 20 10:33:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-e85e3cb1-a244-4822-b8e8-406c4cc0053c req-cbf2c42b-733d-49fa-9000-148f094380bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031971 Apr 20 10:33:35 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:37 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-72c1b078-2a81-4e5f-88d6-ac6a869d29f0 req-75e9eb78-7253-4cf1-9f7d-7080cf0c6337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319eafd3-e6ac-4fcc-92b1-a5f4e60952e8", "name": "network-vif-plugged", "status": "completed", "tag": "f6cef929-1703-4207-bef4-18cfa6e9f6fc"}, {"server_uuid": "319eafd3-e6ac-4fcc-92b1-a5f4e60952e8", "name": "network-vif-deleted", "tag": "f6cef929-1703-4207-bef4-18cfa6e9f6fc"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-72c1b078-2a81-4e5f-88d6-ac6a869d29f0 req-75e9eb78-7253-4cf1-9f7d-7080cf0c6337 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-72c1b078-2a81-4e5f-88d6-ac6a869d29f0 req-75e9eb78-7253-4cf1-9f7d-7080cf0c6337 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-72c1b078-2a81-4e5f-88d6-ac6a869d29f0 req-75e9eb78-7253-4cf1-9f7d-7080cf0c6337 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:37 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-72c1b078-2a81-4e5f-88d6-ac6a869d29f0 req-75e9eb78-7253-4cf1-9f7d-7080cf0c6337 service nova] Creating event network-vif-plugged:f6cef929-1703-4207-bef4-18cfa6e9f6fc for instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 on user Apr 20 10:33:37 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-72c1b078-2a81-4e5f-88d6-ac6a869d29f0 req-75e9eb78-7253-4cf1-9f7d-7080cf0c6337 service nova] Creating event network-vif-deleted:f6cef929-1703-4207-bef4-18cfa6e9f6fc for instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 on user Apr 20 10:33:37 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-72c1b078-2a81-4e5f-88d6-ac6a869d29f0 req-75e9eb78-7253-4cf1-9f7d-7080cf0c6337 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030395 Apr 20 10:33:37 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 71/216] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:40 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-832cee89-131b-448f-ade5-e97ba9ead9b7 tempest-TestStampPattern-1308060282 tempest-TestStampPattern-1308060282-project-member] Action: 'create', calling method: .version_select at 0x7f122a63b1c0>, body: {"keypair": {"name": "tempest-TestStampPattern-1748663185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7Skv0yRxdznt/kuWSGsskSaOBwc8XGaTDxa8/x5o+7gXjDQZ1saeAFq37fOCpr+f+vmqeZq8Vaz8Bz36vFwG0Hr27QWK0lSk6PhHIfcsBlv6txOFhuKVnbHPVGCiaXjA=="}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:40 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-832cee89-131b-448f-ade5-e97ba9ead9b7 tempest-TestStampPattern-1308060282 tempest-TestStampPattern-1308060282-project-member] Getting quotas for project a9ee9a816ac5445bbaca19e27b0e867f. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:33:40 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-832cee89-131b-448f-ade5-e97ba9ead9b7 tempest-TestStampPattern-1308060282 tempest-TestStampPattern-1308060282-project-member] Getting quotas for user beae23b5738e4e84b5f8b28c8d57a9b9 and project a9ee9a816ac5445bbaca19e27b0e867f. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:33:40 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-832cee89-131b-448f-ade5-e97ba9ead9b7 tempest-TestStampPattern-1308060282 tempest-TestStampPattern-1308060282-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.145066 Apr 20 10:33:40 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 73/217] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:33:40 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:42 user devstack@n-api.service[61649]: DEBUG nova.objects.instance [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lazy-loading 'flavor' on Instance uuid 50cff6dc-1947-417a-8c5f-0b10de5dfd3a {{(pid=61649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 10:33:42 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-b023db88-2c8f-4ded-bcb2-76944215080a tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "POST /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a/action" status: 200 len: 32 microversion: 2.1 time: 0.136840 Apr 20 10:33:42 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 74/218] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 10:33:42 2023] POST /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:42 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:43 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-6bd41018-3428-421f-a307-8e50d10f0a05 tempest-TestStampPattern-1308060282 tempest-TestStampPattern-1308060282-project-member] Calling method '.version_select at 0x7f122a694940>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:33:43 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-6bd41018-3428-421f-a307-8e50d10f0a05 tempest-TestStampPattern-1308060282 tempest-TestStampPattern-1308060282-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1748663185" status: 202 len: 0 microversion: 2.1 time: 0.024011 Apr 20 10:33:43 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 74/219] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:33:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1748663185 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:33:43 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:33:43 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-6d3f0262-b095-4d6c-96be-c68f54ce6dab tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a" status: 200 len: 1510 microversion: 2.1 time: 0.667855 Apr 20 10:33:43 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 72/220] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:33:42 2023] GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a => generated 1510 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:33:44 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-cba27ae4-2ead-4b0b-bed6-ca4eaf5cc55a req-284cf5b5-0267-4f43-9380-d56837beadcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-unplugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:44 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-cba27ae4-2ead-4b0b-bed6-ca4eaf5cc55a req-284cf5b5-0267-4f43-9380-d56837beadcc service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:44 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-cba27ae4-2ead-4b0b-bed6-ca4eaf5cc55a req-284cf5b5-0267-4f43-9380-d56837beadcc service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:44 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-cba27ae4-2ead-4b0b-bed6-ca4eaf5cc55a req-284cf5b5-0267-4f43-9380-d56837beadcc service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:44 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-cba27ae4-2ead-4b0b-bed6-ca4eaf5cc55a req-284cf5b5-0267-4f43-9380-d56837beadcc service nova] Creating event network-vif-unplugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:33:44 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-cba27ae4-2ead-4b0b-bed6-ca4eaf5cc55a req-284cf5b5-0267-4f43-9380-d56837beadcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028622 Apr 20 10:33:44 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:46 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=10 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:33:46 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-5cf3fbd2-2dd1-43a5-9f7b-53385fda9ed9 req-2a24a8a9-d79d-4de3-87f7-5521231b60cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-plugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-5cf3fbd2-2dd1-43a5-9f7b-53385fda9ed9 req-2a24a8a9-d79d-4de3-87f7-5521231b60cb service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-5cf3fbd2-2dd1-43a5-9f7b-53385fda9ed9 req-2a24a8a9-d79d-4de3-87f7-5521231b60cb service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-5cf3fbd2-2dd1-43a5-9f7b-53385fda9ed9 req-2a24a8a9-d79d-4de3-87f7-5521231b60cb service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:46 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-5cf3fbd2-2dd1-43a5-9f7b-53385fda9ed9 req-2a24a8a9-d79d-4de3-87f7-5521231b60cb service nova] Creating event network-vif-plugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:33:46 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-5cf3fbd2-2dd1-43a5-9f7b-53385fda9ed9 req-2a24a8a9-d79d-4de3-87f7-5521231b60cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036774 Apr 20 10:33:46 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 75/222] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:33:48 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-910ffff1-2de0-432c-a70e-30a75c499679 req-8393d1ae-8ae7-42a9-b933-d0c808fca0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-plugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}, {"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-plugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:33:48 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-910ffff1-2de0-432c-a70e-30a75c499679 req-8393d1ae-8ae7-42a9-b933-d0c808fca0e7 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:33:48 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-910ffff1-2de0-432c-a70e-30a75c499679 req-8393d1ae-8ae7-42a9-b933-d0c808fca0e7 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:33:48 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-910ffff1-2de0-432c-a70e-30a75c499679 req-8393d1ae-8ae7-42a9-b933-d0c808fca0e7 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:33:48 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-910ffff1-2de0-432c-a70e-30a75c499679 req-8393d1ae-8ae7-42a9-b933-d0c808fca0e7 service nova] Creating event network-vif-plugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:33:48 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-910ffff1-2de0-432c-a70e-30a75c499679 req-8393d1ae-8ae7-42a9-b933-d0c808fca0e7 service nova] Creating event network-vif-plugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:33:48 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-910ffff1-2de0-432c-a70e-30a75c499679 req-8393d1ae-8ae7-42a9-b933-d0c808fca0e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032802 Apr 20 10:33:48 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 73/223] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:33:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=8 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] [instance: 9189f862-2e91-4420-ab64-54375c4f9466] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:01 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] HTTP exception thrown: Instance 9189f862-2e91-4420-ab64-54375c4f9466 could not be found. Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Request method failure captured: Apr 20 10:34:01 user devstack@n-api.service[61649]: request: GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466 HTTP/1.1 Apr 20 10:34:01 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:34:01 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:34:01 user devstack@n-api.service[61649]: Connection: close Apr 20 10:34:01 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:34:01 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:34:01 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:34:01 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:34:01 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRO9uxZ_j4TYX2wETQSeg9BCBKLVEfWQnqVapOjvr-063hM4ysONBwM-7gpO-h1PQXG52s_0MyAo9kxG2czl9bOltnWRZ9qrsZmfcQjDeoOijcrbA8d4ZbNP2S6EjVBYFcZ0FowBQbF1GEv6T0CtZWQ091OarCCfvrxziay9BK8jy5U Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Project-Id: 7c3ecc1463ec42eea56f2890b032ef7a Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Project-Name: tempest-VolumesAdminNegativeTest-2134667240 Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c3ecc1463ec42eea56f2890b032ef7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c3ecc1463ec42eea56f2890b032ef7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c3ecc1463ec42eea56f2890b032ef7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Tenant: tempest-VolumesAdminNegativeTest-2134667240 Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Tenant-Id: 7c3ecc1463ec42eea56f2890b032ef7a Apr 20 10:34:01 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2134667240 Apr 20 10:34:01 user devstack@n-api.service[61649]: X-User: tempest-VolumesAdminNegativeTest-2134667240-project-member Apr 20 10:34:01 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:34:01 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:34:01 user devstack@n-api.service[61649]: X-User-Id: 712be6d6876f4b2c9d796e406a43f8bf Apr 20 10:34:01 user devstack@n-api.service[61649]: X-User-Name: tempest-VolumesAdminNegativeTest-2134667240-project-member Apr 20 10:34:01 user devstack@n-api.service[61649]: method: > Apr 20 10:34:01 user devstack@n-api.service[61649]: exception: Instance 9189f862-2e91-4420-ab64-54375c4f9466 could not be found. Apr 20 10:34:01 user devstack@n-api.service[61649]: action_args: {'id': '9189f862-2e91-4420-ab64-54375c4f9466'} Apr 20 10:34:01 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9189f862-2e91-4420-ab64-54375c4f9466 could not be found. Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9189f862-2e91-4420-ab64-54375c4f9466 could not be found. Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9189f862-2e91-4420-ab64-54375c4f9466 could not be found. Apr 20 10:34:01 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Returning 404 to user: Instance 9189f862-2e91-4420-ab64-54375c4f9466 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:01 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-faa25661-7618-4a72-8d02-c98e962e18f4 tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466" status: 404 len: 111 microversion: 2.1 time: 0.241253 Apr 20 10:34:01 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:01 2023] GET /compute/v2.1/servers/9189f862-2e91-4420-ab64-54375c4f9466 => generated 111 bytes in 244 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:01 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:01 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:01 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-de2d3148-b563-4651-b49d-1d1ab5429a4d tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] Calling method '.version_select at 0x7f122a63d480>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:01 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] HTTP exception thrown: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Request method failure captured: Apr 20 10:34:01 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af HTTP/1.1 Apr 20 10:34:01 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:34:01 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:34:01 user devstack@n-api.service[61647]: Connection: close Apr 20 10:34:01 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:34:01 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:34:01 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:34:01 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:34:01 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRPBCOVlJJsxrIu6MU4L3RLp2zYN_qN67GVRvcPxtpP4wNQNDE8yUeeAqodk6psZpFdsHcATmByVsWQU6rVQnC81YTZTzQz-0leU2j-_i7hdAuhSwrhexIYFVHPtQHmW1SexytXyP0JcaGhgoPaLXXRDfUWHJsV6TjWzjq9dxE6woQ8 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Project-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b4a2af680394ec889b4661753658b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Tenant-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:01 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:34:01 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:34:01 user devstack@n-api.service[61647]: X-User-Id: 67955d2e81c04b8d8dbcbe577303e025 Apr 20 10:34:01 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:01 user devstack@n-api.service[61647]: method: > Apr 20 10:34:01 user devstack@n-api.service[61647]: exception: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:01 user devstack@n-api.service[61647]: action_args: {'id': 'afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af'} Apr 20 10:34:01 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:01 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:01 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Returning 404 to user: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:01 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-cef4d409-6ff5-43af-8306-b272e557460e tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af" status: 404 len: 111 microversion: 2.1 time: 0.242006 Apr 20 10:34:01 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 76/225] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:01 2023] GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:01 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-de2d3148-b563-4651-b49d-1d1ab5429a4d tempest-VolumesAdminNegativeTest-2134667240 tempest-VolumesAdminNegativeTest-2134667240-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241550354" status: 202 len: 0 microversion: 2.1 time: 0.028223 Apr 20 10:34:01 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-4db3b431-e807-4459-9728-5e0f2adbb2d9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '.version_select at 0x7f122a7015a0>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:01 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 74/226] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 10:34:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241550354 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:34:01 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-4db3b431-e807-4459-9728-5e0f2adbb2d9 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262941358" status: 202 len: 0 microversion: 2.1 time: 0.028378 Apr 20 10:34:01 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 10:34:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262941358 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] HTTP exception thrown: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Request method failure captured: Apr 20 10:34:02 user devstack@n-api.service[61647]: request: DELETE /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af HTTP/1.1 Apr 20 10:34:02 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:34:02 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:34:02 user devstack@n-api.service[61647]: Connection: close Apr 20 10:34:02 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:34:02 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:34:02 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:34:02 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:34:02 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRPBCOVlJJsxrIu6MU4L3RLp2zYN_qN67GVRvcPxtpP4wNQNDE8yUeeAqodk6psZpFdsHcATmByVsWQU6rVQnC81YTZTzQz-0leU2j-_i7hdAuhSwrhexIYFVHPtQHmW1SexytXyP0JcaGhgoPaLXXRDfUWHJsV6TjWzjq9dxE6woQ8 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b4a2af680394ec889b4661753658b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Tenant-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Id: 67955d2e81c04b8d8dbcbe577303e025 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61647]: method: > Apr 20 10:34:02 user devstack@n-api.service[61647]: exception: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: action_args: {'id': 'afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af'} Apr 20 10:34:02 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Returning 404 to user: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-faced37a-d262-4ea9-9ec8-15da59bc8e35 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af" status: 404 len: 111 microversion: 2.1 time: 0.029874 Apr 20 10:34:02 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:34:02 2023] DELETE /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] HTTP exception thrown: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Request method failure captured: Apr 20 10:34:02 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af HTTP/1.1 Apr 20 10:34:02 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:34:02 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:34:02 user devstack@n-api.service[61648]: Connection: close Apr 20 10:34:02 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:34:02 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:34:02 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:34:02 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:34:02 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRPBCOVlJJsxrIu6MU4L3RLp2zYN_qN67GVRvcPxtpP4wNQNDE8yUeeAqodk6psZpFdsHcATmByVsWQU6rVQnC81YTZTzQz-0leU2j-_i7hdAuhSwrhexIYFVHPtQHmW1SexytXyP0JcaGhgoPaLXXRDfUWHJsV6TjWzjq9dxE6woQ8 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Project-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Project-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b4a2af680394ec889b4661753658b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Tenant: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Tenant-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-User: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61648]: X-User-Id: 67955d2e81c04b8d8dbcbe577303e025 Apr 20 10:34:02 user devstack@n-api.service[61648]: X-User-Name: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61648]: method: > Apr 20 10:34:02 user devstack@n-api.service[61648]: exception: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61648]: action_args: {'id': 'afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af'} Apr 20 10:34:02 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. Apr 20 10:34:02 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Returning 404 to user: Instance afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:02 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-48ddfbba-03a8-4b4d-839e-da69459c3890 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af" status: 404 len: 111 microversion: 2.1 time: 0.038797 Apr 20 10:34:02 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:02 2023] GET /compute/v2.1/servers/afd69aaa-b7e6-4ae5-a4ef-4b7da89c84af => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] HTTP exception thrown: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Request method failure captured: Apr 20 10:34:02 user devstack@n-api.service[61649]: request: DELETE /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 HTTP/1.1 Apr 20 10:34:02 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:34:02 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:34:02 user devstack@n-api.service[61649]: Connection: close Apr 20 10:34:02 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:34:02 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:34:02 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:34:02 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:34:02 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRPBCOVlJJsxrIu6MU4L3RLp2zYN_qN67GVRvcPxtpP4wNQNDE8yUeeAqodk6psZpFdsHcATmByVsWQU6rVQnC81YTZTzQz-0leU2j-_i7hdAuhSwrhexIYFVHPtQHmW1SexytXyP0JcaGhgoPaLXXRDfUWHJsV6TjWzjq9dxE6woQ8 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Project-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Project-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b4a2af680394ec889b4661753658b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Tenant: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Tenant-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-User: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61649]: X-User-Id: 67955d2e81c04b8d8dbcbe577303e025 Apr 20 10:34:02 user devstack@n-api.service[61649]: X-User-Name: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61649]: method: > Apr 20 10:34:02 user devstack@n-api.service[61649]: exception: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61649]: action_args: {'id': '0f7a669c-28aa-42d2-8991-5852336c0f42'} Apr 20 10:34:02 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Returning 404 to user: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:02 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-53b6ea16-938f-4dc3-8245-8abeb977840d tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42" status: 404 len: 111 microversion: 2.1 time: 0.026852 Apr 20 10:34:02 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 78/230] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:34:02 2023] DELETE /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] [instance: 0f7a669c-28aa-42d2-8991-5852336c0f42] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] HTTP exception thrown: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Request method failure captured: Apr 20 10:34:02 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 HTTP/1.1 Apr 20 10:34:02 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:34:02 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:34:02 user devstack@n-api.service[61647]: Connection: close Apr 20 10:34:02 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:34:02 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:34:02 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:34:02 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:34:02 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRPBCOVlJJsxrIu6MU4L3RLp2zYN_qN67GVRvcPxtpP4wNQNDE8yUeeAqodk6psZpFdsHcATmByVsWQU6rVQnC81YTZTzQz-0leU2j-_i7hdAuhSwrhexIYFVHPtQHmW1SexytXyP0JcaGhgoPaLXXRDfUWHJsV6TjWzjq9dxE6woQ8 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b4a2af680394ec889b4661753658b01"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b4a2af680394ec889b4661753658b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Tenant-Id: 1b4a2af680394ec889b4661753658b01 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1715839687 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Id: 67955d2e81c04b8d8dbcbe577303e025 Apr 20 10:34:02 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeTestJSON-1715839687-project-member Apr 20 10:34:02 user devstack@n-api.service[61647]: method: > Apr 20 10:34:02 user devstack@n-api.service[61647]: exception: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: action_args: {'id': '0f7a669c-28aa-42d2-8991-5852336c0f42'} Apr 20 10:34:02 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. Apr 20 10:34:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:34:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] Returning 404 to user: Instance 0f7a669c-28aa-42d2-8991-5852336c0f42 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-ce83f223-b648-42a9-9ce4-78d87b66b5b3 tempest-AttachVolumeTestJSON-1715839687 tempest-AttachVolumeTestJSON-1715839687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42" status: 404 len: 111 microversion: 2.1 time: 0.029648 Apr 20 10:34:02 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:02 2023] GET /compute/v2.1/servers/0f7a669c-28aa-42d2-8991-5852336c0f42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:07 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-0ebaa872-fd72-4f81-b491-f3104d849215 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] Action: 'create', calling method: .version_select at 0x7f122a63eb90>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-945337698"}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:07 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-0ebaa872-fd72-4f81-b491-f3104d849215 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.566371 Apr 20 10:34:07 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 76/232] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 20 10:34:07 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 568 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 10:34:08 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-20a255c4-057c-43c8-afe1-e357b8b03cd8 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] Calling method '.version_select at 0x7f122a623d90>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:08 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-20a255c4-057c-43c8-afe1-e357b8b03cd8 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5" status: 200 len: 341 microversion: 2.1 time: 0.157126 Apr 20 10:34:08 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 79/233] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 10:34:08 2023] GET /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5 => generated 341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:34:09 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-3b4f5015-e785-4731-a784-ab34499d6958 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] Calling method '.version_select at 0x7f122a63ae60>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:09 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-3b4f5015-e785-4731-a784-ab34499d6958 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5" status: 200 len: 341 microversion: 2.1 time: 0.058405 Apr 20 10:34:09 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 79/234] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 10:34:09 2023] GET /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5 => generated 341 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 10:34:09 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-e6b4c318-bac1-42ae-8a91-aa9d52349a2c tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] Calling method '.version_select at 0x7f122a695f30>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:09 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-e6b4c318-bac1-42ae-8a91-aa9d52349a2c tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5" status: 202 len: 0 microversion: 2.1 time: 0.108320 Apr 20 10:34:09 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 77/235] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:34:09 2023] DELETE /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:34:09 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-95010b51-dd76-447a-b4f1-1567d2f69d21 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] Calling method '.version_select at 0x7f122a6237f0>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:09 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-95010b51-dd76-447a-b4f1-1567d2f69d21 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] HTTP exception thrown: Volume e31d8e21-034f-4211-9e89-60d6626709c5 could not be found. Apr 20 10:34:09 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-95010b51-dd76-447a-b4f1-1567d2f69d21 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] Request method failure captured: Apr 20 10:34:09 user devstack@n-api.service[61649]: request: GET /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5 HTTP/1.1 Apr 20 10:34:09 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:34:09 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:34:09 user devstack@n-api.service[61649]: Connection: close Apr 20 10:34:09 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:34:09 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:34:09 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:34:09 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:34:09 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRUf-xEnKdFb0TwqmQsRI2D2EBOd0X3YCbdsdQ16wL6bdCZJ0_Lani6qeUm5gXFi0GbbVCgdnt_GC8m4ZW9HlWvtt29x9Ub_fCfcsLi29v4hXpcdMf1CtbUarNW3qTNz6CFhBeq64-XSIZxLcs5wq_mU_LsNHDzfy4Y0GpoDGq3rVek Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Project-Id: ff513cdda4a7474c850bbc1bfbed2210 Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-440813343 Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ff513cdda4a7474c850bbc1bfbed2210"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ff513cdda4a7474c850bbc1bfbed2210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ff513cdda4a7474c850bbc1bfbed2210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Tenant: tempest-VolumesSnapshotsTestJSON-440813343 Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Tenant-Id: ff513cdda4a7474c850bbc1bfbed2210 Apr 20 10:34:09 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-440813343 Apr 20 10:34:09 user devstack@n-api.service[61649]: X-User: tempest-VolumesSnapshotsTestJSON-440813343-project-member Apr 20 10:34:09 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:34:09 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:34:09 user devstack@n-api.service[61649]: X-User-Id: e1a2ef158ddd4f81b33e91e8e0835d84 Apr 20 10:34:09 user devstack@n-api.service[61649]: X-User-Name: tempest-VolumesSnapshotsTestJSON-440813343-project-member Apr 20 10:34:09 user devstack@n-api.service[61649]: method: Apr 20 10:34:09 user devstack@n-api.service[61649]: exception: Volume e31d8e21-034f-4211-9e89-60d6626709c5 could not be found. Apr 20 10:34:09 user devstack@n-api.service[61649]: action_args: {'id': 'e31d8e21-034f-4211-9e89-60d6626709c5'} Apr 20 10:34:09 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e31d8e21-034f-4211-9e89-60d6626709c5 could not be found. (HTTP 404) (Request-ID: req-1143e2b0-a45e-4866-ae55-0bdb7ae54e6f) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e31d8e21-034f-4211-9e89-60d6626709c5 could not be found. Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e31d8e21-034f-4211-9e89-60d6626709c5 could not be found. Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e31d8e21-034f-4211-9e89-60d6626709c5 could not be found. Apr 20 10:34:09 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:34:09 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-95010b51-dd76-447a-b4f1-1567d2f69d21 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] Returning 404 to user: Volume e31d8e21-034f-4211-9e89-60d6626709c5 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:09 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-95010b51-dd76-447a-b4f1-1567d2f69d21 tempest-VolumesSnapshotsTestJSON-440813343 tempest-VolumesSnapshotsTestJSON-440813343-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5" status: 404 len: 109 microversion: 2.1 time: 0.035667 Apr 20 10:34:09 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 80/236] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 10:34:09 2023] GET /compute/v2.1/os-volumes/e31d8e21-034f-4211-9e89-60d6626709c5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:17 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:34:17 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-5ea0a7e1-dab5-4225-b60b-a35c2073770f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.278495 Apr 20 10:34:17 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 80/237] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:17 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:25 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:34:25 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 HTTP/1.1 Apr 20 10:34:25 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:34:25 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:34:25 user devstack@n-api.service[61648]: Connection: close Apr 20 10:34:25 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:34:25 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:34:25 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:34:25 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:34:25 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:34:25 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:34:25 user devstack@n-api.service[61648]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:34:25 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:34:25 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:34:25 user devstack@n-api.service[61648]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:34:25 user devstack@n-api.service[61648]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:34:25 user devstack@n-api.service[61648]: method: > Apr 20 10:34:25 user devstack@n-api.service[61648]: exception: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:34:25 user devstack@n-api.service[61648]: action_args: {'id': '319eafd3-e6ac-4fcc-92b1-a5f4e60952e8'} Apr 20 10:34:25 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:34:25 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:34:25 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:34:25 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-f1d403ac-da6f-4a46-a162-78d29d75cfcd tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8" status: 404 len: 111 microversion: 2.1 time: 0.032611 Apr 20 10:34:25 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 78/238] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:25 2023] GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:34:25 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:25 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:25 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-a517f2b7-6628-48a9-9b81-aaeffb48822c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '.version_select at 0x7f122a623130>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:25 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-a517f2b7-6628-48a9-9b81-aaeffb48822c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859145494" status: 202 len: 0 microversion: 2.1 time: 0.024895 Apr 20 10:34:25 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 10:34:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859145494 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:34:26 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-c82fb12d-0566-4360-b66b-ca4b01fe796f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Action: 'create', calling method: .version_select at 0x7f122a63b1c0>, body: {"keypair": {"name": "tempest-keypair-1070174971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlXb2fBMUpwjWcMzz3zehln+ROLLyuvx1FKwns94rOIHkQii3UgvuVBxZIQ5wQRDDXLv5B8P3RJ3QpXQC3Ze1OezsE+YLGNFce+g2+NCB+C/troUPUvbU32x8whbZGnag=="}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:26 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-c82fb12d-0566-4360-b66b-ca4b01fe796f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for project 12e621999b00481c839affc4e83ce37c. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:34:26 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-c82fb12d-0566-4360-b66b-ca4b01fe796f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for user 2a04be58cd354d508616edd9d5eeff54 and project 12e621999b00481c839affc4e83ce37c. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:34:26 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-c82fb12d-0566-4360-b66b-ca4b01fe796f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046801 Apr 20 10:34:26 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 81/240] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:34:26 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:34:27 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1225264902", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "51b24d7b-a37b-453a-a335-3ba809f26953"}], "security_groups": [{"name": "tempest-securitygroup--1841382343"}], "key_name": "tempest-keypair-1070174971", "user_data": "}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] validate_networks() for [('51b24d7b-a37b-453a-a335-3ba809f26953', None, None, None, None, None)] {{(pid=61648) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Flavor limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Image limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Flavor pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Image pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for project 12e621999b00481c839affc4e83ce37c. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for user 2a04be58cd354d508616edd9d5eeff54 and project 12e621999b00481c839affc4e83ce37c. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Going to run 1 instances... {{(pid=61648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:34:28 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:34:28 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-1e63bb7f-2b15-44e0-8add-32b00a109f18 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.833489 Apr 20 10:34:28 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 79/241] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:34:27 2023] POST /compute/v2.1/servers => generated 400 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:34:28 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-928d1ce6-4cd0-4992-8aba-5a150bca8220 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:28 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-928d1ce6-4cd0-4992-8aba-5a150bca8220 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:28 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-928d1ce6-4cd0-4992-8aba-5a150bca8220 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:34:28 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-928d1ce6-4cd0-4992-8aba-5a150bca8220 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b" status: 200 len: 1236 microversion: 2.1 time: 0.072706 Apr 20 10:34:28 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 82/242] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:28 2023] GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:34:31 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:31 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-cfb8e9a9-db14-4836-98d4-64ec5d91212b req-3416944e-20c8-4d77-a605-38dcc4aca289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d73c323-31d8-4695-b8e2-5826c73ebb6b", "tag": "a9863408-9295-4836-b0a6-b785f76c092a"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-cfb8e9a9-db14-4836-98d4-64ec5d91212b req-3416944e-20c8-4d77-a605-38dcc4aca289 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-cfb8e9a9-db14-4836-98d4-64ec5d91212b req-3416944e-20c8-4d77-a605-38dcc4aca289 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-cfb8e9a9-db14-4836-98d4-64ec5d91212b req-3416944e-20c8-4d77-a605-38dcc4aca289 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:31 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-cfb8e9a9-db14-4836-98d4-64ec5d91212b req-3416944e-20c8-4d77-a605-38dcc4aca289 service nova] Creating event network-changed:a9863408-9295-4836-b0a6-b785f76c092a for instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b on user Apr 20 10:34:31 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-cfb8e9a9-db14-4836-98d4-64ec5d91212b req-3416944e-20c8-4d77-a605-38dcc4aca289 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039232 Apr 20 10:34:31 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:34:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:33 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:34:33 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-2a3450cc-2071-4a02-a289-879b77413f29 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a" status: 200 len: 1490 microversion: 2.1 time: 0.300399 Apr 20 10:34:33 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 80/244] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:33 2023] GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a => generated 1490 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:34:34 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-6d8b7c82-faba-45fc-b57f-1a4ed58f6c6d req-1424676f-5269-424a-b6d2-0cfbd563e845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d73c323-31d8-4695-b8e2-5826c73ebb6b", "name": "network-vif-plugged", "status": "completed", "tag": "a9863408-9295-4836-b0a6-b785f76c092a"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-6d8b7c82-faba-45fc-b57f-1a4ed58f6c6d req-1424676f-5269-424a-b6d2-0cfbd563e845 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-6d8b7c82-faba-45fc-b57f-1a4ed58f6c6d req-1424676f-5269-424a-b6d2-0cfbd563e845 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:34 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-6d8b7c82-faba-45fc-b57f-1a4ed58f6c6d req-1424676f-5269-424a-b6d2-0cfbd563e845 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:34 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-6d8b7c82-faba-45fc-b57f-1a4ed58f6c6d req-1424676f-5269-424a-b6d2-0cfbd563e845 service nova] Creating event network-vif-plugged:a9863408-9295-4836-b0a6-b785f76c092a for instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b on user Apr 20 10:34:34 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-6d8b7c82-faba-45fc-b57f-1a4ed58f6c6d req-1424676f-5269-424a-b6d2-0cfbd563e845 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186514 Apr 20 10:34:34 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 83/245] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:34:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:34:36 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-f37d149c-05b1-45b7-aa52-9b5b5c5d138d req-62b51edb-3a70-456f-ae18-4f2704dbf6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d73c323-31d8-4695-b8e2-5826c73ebb6b", "name": "network-vif-plugged", "status": "completed", "tag": "a9863408-9295-4836-b0a6-b785f76c092a"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f37d149c-05b1-45b7-aa52-9b5b5c5d138d req-62b51edb-3a70-456f-ae18-4f2704dbf6d0 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f37d149c-05b1-45b7-aa52-9b5b5c5d138d req-62b51edb-3a70-456f-ae18-4f2704dbf6d0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f37d149c-05b1-45b7-aa52-9b5b5c5d138d req-62b51edb-3a70-456f-ae18-4f2704dbf6d0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:36 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-f37d149c-05b1-45b7-aa52-9b5b5c5d138d req-62b51edb-3a70-456f-ae18-4f2704dbf6d0 service nova] Creating event network-vif-plugged:a9863408-9295-4836-b0a6-b785f76c092a for instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b on user Apr 20 10:34:36 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-f37d149c-05b1-45b7-aa52-9b5b5c5d138d req-62b51edb-3a70-456f-ae18-4f2704dbf6d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Apr 20 10:34:36 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 83/246] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:34:55 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-06c829ed-f2b1-4e6f-bb2d-2bd3d64ecb10 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Action: 'create', calling method: .version_select at 0x7f122a697d90>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-693580580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPha8UTs+y6zQwYiHYJU8S3tkn97JtlaaAeIMql6mOiK4l9+Zu9OIlPQG4QaIz4bSwaRtyjprIcWT35a8BtT0jDPIeyBy776x5V6SLLxayNSY8lG5hkGVg+EEmbLws1bHQ=="}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:55 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:55 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:55 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:55 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=10 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:55 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-06c829ed-f2b1-4e6f-bb2d-2bd3d64ecb10 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:34:55 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-06c829ed-f2b1-4e6f-bb2d-2bd3d64ecb10 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for user 878178b690704d048c37c79d596e953b and project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:34:55 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-06c829ed-f2b1-4e6f-bb2d-2bd3d64ecb10 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056485 Apr 20 10:34:55 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 81/247] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:34:55 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:34:55 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:55 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:55 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:55 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1531913966", "imageRef": "121cb977-6d50-466e-b474-423e6e1e40c7", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-693580580", "networks": [{"uuid": "0ebbf38f-49de-48cb-ab19-2af234cb93fc"}]}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:55 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] validate_networks() for [('0ebbf38f-49de-48cb-ab19-2af234cb93fc', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for user 878178b690704d048c37c79d596e953b and project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:34:56 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='121cb977-6d50-466e-b474-423e6e1e40c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:34:56 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-433c3dc1-4f10-4eec-80a7-a203dca1d6a5 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.705416 Apr 20 10:34:56 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 84/248] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:34:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:34:56 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:56 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:56 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:34:56 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-0b0578c7-d25c-4fd9-b7b0-be07fdc2d3b9 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:34:56 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-0b0578c7-d25c-4fd9-b7b0-be07fdc2d3b9 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:34:56 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-0b0578c7-d25c-4fd9-b7b0-be07fdc2d3b9 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:34:56 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-0b0578c7-d25c-4fd9-b7b0-be07fdc2d3b9 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f" status: 200 len: 1252 microversion: 2.1 time: 0.069871 Apr 20 10:34:56 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:34:56 2023] GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f => generated 1252 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:34:58 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-951e5fd7-bf1d-4714-999a-1a6435f665f5 req-ea068ee4-e921-4340-9313-150cee8d7c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50181cb3-e752-4b72-a09d-e7fdae1edd8f", "tag": "fb9928c1-f326-4b03-847c-3e450689dedb"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:34:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-951e5fd7-bf1d-4714-999a-1a6435f665f5 req-ea068ee4-e921-4340-9313-150cee8d7c43 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:34:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-951e5fd7-bf1d-4714-999a-1a6435f665f5 req-ea068ee4-e921-4340-9313-150cee8d7c43 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:34:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-951e5fd7-bf1d-4714-999a-1a6435f665f5 req-ea068ee4-e921-4340-9313-150cee8d7c43 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:34:58 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-951e5fd7-bf1d-4714-999a-1a6435f665f5 req-ea068ee4-e921-4340-9313-150cee8d7c43 service nova] Creating event network-changed:fb9928c1-f326-4b03-847c-3e450689dedb for instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f on user Apr 20 10:34:58 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-951e5fd7-bf1d-4714-999a-1a6435f665f5 req-ea068ee4-e921-4340-9313-150cee8d7c43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030140 Apr 20 10:34:58 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 82/250] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:34:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:35:00 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-de82e55b-66ef-4e85-88a9-d6bfefb78a31 req-e3986a51-7abe-4900-8b12-5a51b652e335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50181cb3-e752-4b72-a09d-e7fdae1edd8f", "name": "network-vif-plugged", "status": "completed", "tag": "fb9928c1-f326-4b03-847c-3e450689dedb"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:35:00 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-de82e55b-66ef-4e85-88a9-d6bfefb78a31 req-e3986a51-7abe-4900-8b12-5a51b652e335 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:00 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-de82e55b-66ef-4e85-88a9-d6bfefb78a31 req-e3986a51-7abe-4900-8b12-5a51b652e335 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:00 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-de82e55b-66ef-4e85-88a9-d6bfefb78a31 req-e3986a51-7abe-4900-8b12-5a51b652e335 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:00 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-de82e55b-66ef-4e85-88a9-d6bfefb78a31 req-e3986a51-7abe-4900-8b12-5a51b652e335 service nova] Creating event network-vif-plugged:fb9928c1-f326-4b03-847c-3e450689dedb for instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f on user Apr 20 10:35:00 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-de82e55b-66ef-4e85-88a9-d6bfefb78a31 req-e3986a51-7abe-4900-8b12-5a51b652e335 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029182 Apr 20 10:35:00 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 85/251] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:35:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-185a680a-44cc-4c80-b9c4-29a78246ca55 req-ff51403f-8a3d-412b-b6b0-38f0a0cefe7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50181cb3-e752-4b72-a09d-e7fdae1edd8f", "name": "network-vif-plugged", "status": "completed", "tag": "fb9928c1-f326-4b03-847c-3e450689dedb"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:35:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-185a680a-44cc-4c80-b9c4-29a78246ca55 req-ff51403f-8a3d-412b-b6b0-38f0a0cefe7e service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-185a680a-44cc-4c80-b9c4-29a78246ca55 req-ff51403f-8a3d-412b-b6b0-38f0a0cefe7e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-185a680a-44cc-4c80-b9c4-29a78246ca55 req-ff51403f-8a3d-412b-b6b0-38f0a0cefe7e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:03 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-185a680a-44cc-4c80-b9c4-29a78246ca55 req-ff51403f-8a3d-412b-b6b0-38f0a0cefe7e service nova] Creating event network-vif-plugged:fb9928c1-f326-4b03-847c-3e450689dedb for instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f on user Apr 20 10:35:03 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-185a680a-44cc-4c80-b9c4-29a78246ca55 req-ff51403f-8a3d-412b-b6b0-38f0a0cefe7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039266 Apr 20 10:35:03 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 85/252] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:35:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:17 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:35:17 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-a073b42f-0f79-43a4-8373-ba70f06d9847 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.236384 Apr 20 10:35:17 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 83/253] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:35:17 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:35:17 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:17 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:17 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:17 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:17 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:35:17 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:35:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:18 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:18 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:35:18 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e0afe379-92b4-460d-a8d8-ac05a19e4abb tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.452706 Apr 20 10:35:18 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:35:17 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:18 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:35:18 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-9a90f6b1-b0ae-4df6-9285-4aca0e797bca tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.162321 Apr 20 10:35:18 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 86/255] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:35:18 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:19 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:35:19 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-d6f97481-6dbb-4578-aaf9-c69b1c354525 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b" status: 200 len: 1545 microversion: 2.1 time: 0.219647 Apr 20 10:35:19 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 84/256] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:35:18 2023] GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b => generated 1545 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: e1115ad2-b858-4859-b1bb-2175f7eab867] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:34 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:35:34 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-30fb9bfd-6e4e-4255-919f-8b26fab9bde1 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867" status: 200 len: 1504 microversion: 2.1 time: 0.218829 Apr 20 10:35:34 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 87/257] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:35:33 2023] GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:35:46 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:35:46 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-27bb3aa7-7407-4254-9abd-418039fa0849 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f" status: 200 len: 1535 microversion: 2.1 time: 0.221154 Apr 20 10:35:46 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:35:46 2023] GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f => generated 1535 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=12 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:19 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:19 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-5bde452a-9514-4fe2-9e29-0244893527de tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184291 Apr 20 10:36:19 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 85/259] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:36:19 2023] GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b/os-interface => generated 282 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:20 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-8a51c1eb-4f6d-4f53-8f07-815474832bd0 req-c9206468-6c36-4f65-912e-a6527c98ab46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d73c323-31d8-4695-b8e2-5826c73ebb6b", "tag": "a9863408-9295-4836-b0a6-b785f76c092a"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:20 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:20 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8a51c1eb-4f6d-4f53-8f07-815474832bd0 req-c9206468-6c36-4f65-912e-a6527c98ab46 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8a51c1eb-4f6d-4f53-8f07-815474832bd0 req-c9206468-6c36-4f65-912e-a6527c98ab46 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:20 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-8a51c1eb-4f6d-4f53-8f07-815474832bd0 req-c9206468-6c36-4f65-912e-a6527c98ab46 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:20 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-8a51c1eb-4f6d-4f53-8f07-815474832bd0 req-c9206468-6c36-4f65-912e-a6527c98ab46 service nova] Creating event network-changed:a9863408-9295-4836-b0a6-b785f76c092a for instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b on user Apr 20 10:36:20 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-8a51c1eb-4f6d-4f53-8f07-815474832bd0 req-c9206468-6c36-4f65-912e-a6527c98ab46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033943 Apr 20 10:36:20 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 88/260] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:20 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-7a0af87e-4ef0-4d6a-9a6d-693b8d4b7189 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b/ips" status: 200 len: 107 microversion: 2.1 time: 0.067918 Apr 20 10:36:20 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:36:20 2023] GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b/ips => generated 107 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:20 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:36:20 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-3c3a891e-fb61-412e-9904-fb59ee435f6a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1658 microversion: 2.1 time: 0.374744 Apr 20 10:36:20 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 86/262] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:36:20 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1658 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:21 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:36:21 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-6efdec39-8296-466f-98eb-3273b652a0e5 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b" status: 204 len: 0 microversion: 2.1 time: 0.115041 Apr 20 10:36:21 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 89/263] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:36:21 2023] DELETE /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:22 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:36:22 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-e9cbabdf-0fc9-4f20-8259-fcff1d3733d9 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b" status: 200 len: 1670 microversion: 2.1 time: 0.257664 Apr 20 10:36:22 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 89/264] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:36:21 2023] GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b => generated 1670 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 10:36:22 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-9dc2b74a-e3dc-43c4-8032-6f768d1ab3ce req-262da206-e57f-489d-8e88-5b5cd4a430f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d73c323-31d8-4695-b8e2-5826c73ebb6b", "name": "network-vif-unplugged", "status": "completed", "tag": "a9863408-9295-4836-b0a6-b785f76c092a"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-9dc2b74a-e3dc-43c4-8032-6f768d1ab3ce req-262da206-e57f-489d-8e88-5b5cd4a430f1 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-9dc2b74a-e3dc-43c4-8032-6f768d1ab3ce req-262da206-e57f-489d-8e88-5b5cd4a430f1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-9dc2b74a-e3dc-43c4-8032-6f768d1ab3ce req-262da206-e57f-489d-8e88-5b5cd4a430f1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:22 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-9dc2b74a-e3dc-43c4-8032-6f768d1ab3ce req-262da206-e57f-489d-8e88-5b5cd4a430f1 service nova] Creating event network-vif-unplugged:a9863408-9295-4836-b0a6-b785f76c092a for instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b on user Apr 20 10:36:22 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-9dc2b74a-e3dc-43c4-8032-6f768d1ab3ce req-262da206-e57f-489d-8e88-5b5cd4a430f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032849 Apr 20 10:36:22 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 87/265] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:23 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-9b6d6ffb-9550-4dcb-9c89-2f219e66773e req-078ab178-6582-47a8-99b9-fc15b3c1ee1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d73c323-31d8-4695-b8e2-5826c73ebb6b", "name": "network-vif-deleted", "tag": "a9863408-9295-4836-b0a6-b785f76c092a"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:23 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-9b6d6ffb-9550-4dcb-9c89-2f219e66773e req-078ab178-6582-47a8-99b9-fc15b3c1ee1e service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:23 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-9b6d6ffb-9550-4dcb-9c89-2f219e66773e req-078ab178-6582-47a8-99b9-fc15b3c1ee1e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:23 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-9b6d6ffb-9550-4dcb-9c89-2f219e66773e req-078ab178-6582-47a8-99b9-fc15b3c1ee1e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:23 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-9b6d6ffb-9550-4dcb-9c89-2f219e66773e req-078ab178-6582-47a8-99b9-fc15b3c1ee1e service nova] Creating event network-vif-deleted:a9863408-9295-4836-b0a6-b785f76c092a for instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b on user Apr 20 10:36:23 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-9b6d6ffb-9550-4dcb-9c89-2f219e66773e req-078ab178-6582-47a8-99b9-fc15b3c1ee1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035259 Apr 20 10:36:23 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 90/266] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:24 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-8d26257c-b507-4c48-851f-243f8b2e01dd req-2d1d61b0-e6b3-43b4-90d6-a7c741b6dce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d73c323-31d8-4695-b8e2-5826c73ebb6b", "name": "network-vif-plugged", "status": "completed", "tag": "a9863408-9295-4836-b0a6-b785f76c092a"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-8d26257c-b507-4c48-851f-243f8b2e01dd req-2d1d61b0-e6b3-43b4-90d6-a7c741b6dce0 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-8d26257c-b507-4c48-851f-243f8b2e01dd req-2d1d61b0-e6b3-43b4-90d6-a7c741b6dce0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-8d26257c-b507-4c48-851f-243f8b2e01dd req-2d1d61b0-e6b3-43b4-90d6-a7c741b6dce0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:24 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-8d26257c-b507-4c48-851f-243f8b2e01dd req-2d1d61b0-e6b3-43b4-90d6-a7c741b6dce0 service nova] Creating event network-vif-plugged:a9863408-9295-4836-b0a6-b785f76c092a for instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b on user Apr 20 10:36:24 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-8d26257c-b507-4c48-851f-243f8b2e01dd req-2d1d61b0-e6b3-43b4-90d6-a7c741b6dce0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035689 Apr 20 10:36:24 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 90/267] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=12 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:37 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:36:37 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-6cede009-e454-4acd-9ded-d6bb20b23f36 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a" status: 204 len: 0 microversion: 2.1 time: 0.114635 Apr 20 10:36:37 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 88/268] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:36:37 2023] DELETE /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:37 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:37 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=12 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:36:37 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-f30e2a1b-70f0-4060-8006-0f220081e0dc req-e55f88f2-6589-424f-aa0b-2d54ac6da6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-unplugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:37 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:36:37 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-6e92a705-d779-4bb9-a470-8cc4421c2de6 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a" status: 200 len: 1496 microversion: 2.1 time: 0.261105 Apr 20 10:36:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f30e2a1b-70f0-4060-8006-0f220081e0dc req-e55f88f2-6589-424f-aa0b-2d54ac6da6ac service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:37 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 91/269] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:36:37 2023] GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a => generated 1496 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:36:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f30e2a1b-70f0-4060-8006-0f220081e0dc req-e55f88f2-6589-424f-aa0b-2d54ac6da6ac service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f30e2a1b-70f0-4060-8006-0f220081e0dc req-e55f88f2-6589-424f-aa0b-2d54ac6da6ac service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:37 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-f30e2a1b-70f0-4060-8006-0f220081e0dc req-e55f88f2-6589-424f-aa0b-2d54ac6da6ac service nova] Creating event network-vif-unplugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:36:37 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-f30e2a1b-70f0-4060-8006-0f220081e0dc req-e55f88f2-6589-424f-aa0b-2d54ac6da6ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037783 Apr 20 10:36:37 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 91/270] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:39 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-e6692020-6c2c-47f9-9dc6-f7caed1ae2fb req-54474ef2-ec3a-49a0-b9e6-95f0d673c1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-plugged", "status": "completed", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}, {"server_uuid": "50cff6dc-1947-417a-8c5f-0b10de5dfd3a", "name": "network-vif-deleted", "tag": "56f36d99-9847-4d4d-bf9b-c1c2244bac79"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:39 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-e6692020-6c2c-47f9-9dc6-f7caed1ae2fb req-54474ef2-ec3a-49a0-b9e6-95f0d673c1c4 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:39 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-e6692020-6c2c-47f9-9dc6-f7caed1ae2fb req-54474ef2-ec3a-49a0-b9e6-95f0d673c1c4 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:39 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-e6692020-6c2c-47f9-9dc6-f7caed1ae2fb req-54474ef2-ec3a-49a0-b9e6-95f0d673c1c4 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:39 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-e6692020-6c2c-47f9-9dc6-f7caed1ae2fb req-54474ef2-ec3a-49a0-b9e6-95f0d673c1c4 service nova] Creating event network-vif-plugged:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:36:39 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-e6692020-6c2c-47f9-9dc6-f7caed1ae2fb req-54474ef2-ec3a-49a0-b9e6-95f0d673c1c4 service nova] Creating event network-vif-deleted:56f36d99-9847-4d4d-bf9b-c1c2244bac79 for instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a on user Apr 20 10:36:39 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-e6692020-6c2c-47f9-9dc6-f7caed1ae2fb req-54474ef2-ec3a-49a0-b9e6-95f0d673c1c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030006 Apr 20 10:36:39 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 89/271] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:47 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:36:47 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-a6a25675-47b9-4be4-84ac-b7e2d3cc3ba6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f" status: 200 len: 1535 microversion: 2.1 time: 0.220403 Apr 20 10:36:47 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 92/272] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:36:47 2023] GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f => generated 1535 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Searching by: {'deleted': False, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9'} {{(pid=61647) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:47 user devstack@n-api.service[61647]: DEBUG nova.compute.multi_cell_list [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61647) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 10:36:47 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-c6e811d6-d70a-4612-8fb7-9c2fc76908f2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.200868 Apr 20 10:36:47 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 92/273] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 10:36:47 2023] GET /compute/v2.1/servers => generated 341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:47 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:36:47 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-90c81823-9d69-49ef-9ec0-305852621895 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f" status: 200 len: 1535 microversion: 2.1 time: 0.215091 Apr 20 10:36:47 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 90/274] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:36:47 2023] GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f => generated 1535 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:49 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:36:49 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f7347785-a9f8-43cb-9e2f-e4102f828b07 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f" status: 204 len: 0 microversion: 2.1 time: 0.119387 Apr 20 10:36:49 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 93/275] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:36:49 2023] DELETE /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:49 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:36:49 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-8e418bc5-eeed-46d1-b2e6-d2195ab7108b tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f" status: 200 len: 1541 microversion: 2.1 time: 0.200749 Apr 20 10:36:49 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 93/276] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:36:49 2023] GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:36:49 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-d9453410-2b99-42c7-9929-55eed655c493 req-f905ad73-ce72-454c-9e5a-ea0d21ccdd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50181cb3-e752-4b72-a09d-e7fdae1edd8f", "name": "network-vif-unplugged", "status": "completed", "tag": "fb9928c1-f326-4b03-847c-3e450689dedb"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-d9453410-2b99-42c7-9929-55eed655c493 req-f905ad73-ce72-454c-9e5a-ea0d21ccdd95 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-d9453410-2b99-42c7-9929-55eed655c493 req-f905ad73-ce72-454c-9e5a-ea0d21ccdd95 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-d9453410-2b99-42c7-9929-55eed655c493 req-f905ad73-ce72-454c-9e5a-ea0d21ccdd95 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:49 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-d9453410-2b99-42c7-9929-55eed655c493 req-f905ad73-ce72-454c-9e5a-ea0d21ccdd95 service nova] Creating event network-vif-unplugged:fb9928c1-f326-4b03-847c-3e450689dedb for instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f on user Apr 20 10:36:49 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-d9453410-2b99-42c7-9929-55eed655c493 req-f905ad73-ce72-454c-9e5a-ea0d21ccdd95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028694 Apr 20 10:36:49 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 91/277] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:36:51 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-282ae317-c1ba-4f1c-9d32-400408de849b req-3a91f7be-d951-40ba-9647-ecb7d8ae1351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50181cb3-e752-4b72-a09d-e7fdae1edd8f", "name": "network-vif-plugged", "status": "completed", "tag": "fb9928c1-f326-4b03-847c-3e450689dedb"}, {"server_uuid": "50181cb3-e752-4b72-a09d-e7fdae1edd8f", "name": "network-vif-deleted", "tag": "fb9928c1-f326-4b03-847c-3e450689dedb"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:36:51 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-282ae317-c1ba-4f1c-9d32-400408de849b req-3a91f7be-d951-40ba-9647-ecb7d8ae1351 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:36:51 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-282ae317-c1ba-4f1c-9d32-400408de849b req-3a91f7be-d951-40ba-9647-ecb7d8ae1351 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:36:51 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-282ae317-c1ba-4f1c-9d32-400408de849b req-3a91f7be-d951-40ba-9647-ecb7d8ae1351 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:36:51 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-282ae317-c1ba-4f1c-9d32-400408de849b req-3a91f7be-d951-40ba-9647-ecb7d8ae1351 service nova] Creating event network-vif-plugged:fb9928c1-f326-4b03-847c-3e450689dedb for instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f on user Apr 20 10:36:51 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-282ae317-c1ba-4f1c-9d32-400408de849b req-3a91f7be-d951-40ba-9647-ecb7d8ae1351 service nova] Creating event network-vif-deleted:fb9928c1-f326-4b03-847c-3e450689dedb for instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f on user Apr 20 10:36:51 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-282ae317-c1ba-4f1c-9d32-400408de849b req-3a91f7be-d951-40ba-9647-ecb7d8ae1351 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038832 Apr 20 10:36:51 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 94/278] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:36:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=16 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:12 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:37:12 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b HTTP/1.1 Apr 20 10:37:12 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:37:12 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:37:12 user devstack@n-api.service[61647]: Connection: close Apr 20 10:37:12 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:37:12 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:37:12 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:37:12 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:37:12 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:37:12 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:37:12 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:37:12 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:37:12 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:37:12 user devstack@n-api.service[61647]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:37:12 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:37:12 user devstack@n-api.service[61647]: method: > Apr 20 10:37:12 user devstack@n-api.service[61647]: exception: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:37:12 user devstack@n-api.service[61647]: action_args: {'id': '5d73c323-31d8-4695-b8e2-5826c73ebb6b'} Apr 20 10:37:12 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:37:12 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:12 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:37:12 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-6ce6c991-8cfa-4e94-8ece-d6f2c5215e6d tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b" status: 404 len: 111 microversion: 2.1 time: 0.253570 Apr 20 10:37:12 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 94/279] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:37:12 2023] GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b => generated 111 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:37:12 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:12 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:12 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-8cd0d7bf-4116-4eb0-89ff-08330b3b2f87 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '.version_select at 0x7f122a697250>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:12 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-8cd0d7bf-4116-4eb0-89ff-08330b3b2f87 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070174971" status: 202 len: 0 microversion: 2.1 time: 0.028905 Apr 20 10:37:12 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 92/280] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 10:37:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070174971 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:37:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:13 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:13 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-88c92c81-db97-4fdf-a907-c1ae70aba373 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Action: 'create', calling method: .version_select at 0x7f122a876ef0>, body: {"keypair": {"name": "tempest-keypair-58831496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJsFZ6zFqNNpK8NNtdhopwc6Wl3+Dy9fVkPXioOSVb5zIBlsJr3Vfpw4JSmE38Ewd24wugKZHZWDCHIcSgnyz2KZEoYLhZutGGub8KFvP0CYywEgGYJIN+RHNtlh3mNweQ=="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:13 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-88c92c81-db97-4fdf-a907-c1ae70aba373 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for project 12e621999b00481c839affc4e83ce37c. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:37:13 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-88c92c81-db97-4fdf-a907-c1ae70aba373 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for user 2a04be58cd354d508616edd9d5eeff54 and project 12e621999b00481c839affc4e83ce37c. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:37:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-88c92c81-db97-4fdf-a907-c1ae70aba373 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.068631 Apr 20 10:37:13 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 95/281] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:37:13 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:14 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1283873387", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "51b24d7b-a37b-453a-a335-3ba809f26953"}], "security_groups": [{"name": "tempest-securitygroup--1982426905"}], "key_name": "tempest-keypair-58831496", "user_data": "}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:14 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] validate_networks() for [('51b24d7b-a37b-453a-a335-3ba809f26953', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for project 12e621999b00481c839affc4e83ce37c. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Getting quotas for user 2a04be58cd354d508616edd9d5eeff54 and project 12e621999b00481c839affc4e83ce37c. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:37:15 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:37:15 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-f736c356-5d06-4c49-ac43-efd99cde0dc7 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.635443 Apr 20 10:37:15 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 95/282] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:37:14 2023] POST /compute/v2.1/servers => generated 400 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:37:15 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-fd77daae-5f13-401a-b9ff-6750db77248c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:15 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-fd77daae-5f13-401a-b9ff-6750db77248c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:15 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-fd77daae-5f13-401a-b9ff-6750db77248c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:37:15 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-fd77daae-5f13-401a-b9ff-6750db77248c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d" status: 200 len: 1234 microversion: 2.1 time: 0.062937 Apr 20 10:37:15 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 93/283] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:37:15 2023] GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d => generated 1234 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:37:17 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-564d1526-1eba-4f62-90b7-f37efec8cfac req-eb7580c8-c1a7-46cf-bd1b-87bbb6767c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:17 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-564d1526-1eba-4f62-90b7-f37efec8cfac req-eb7580c8-c1a7-46cf-bd1b-87bbb6767c8f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:17 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-564d1526-1eba-4f62-90b7-f37efec8cfac req-eb7580c8-c1a7-46cf-bd1b-87bbb6767c8f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:17 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-564d1526-1eba-4f62-90b7-f37efec8cfac req-eb7580c8-c1a7-46cf-bd1b-87bbb6767c8f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:17 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-564d1526-1eba-4f62-90b7-f37efec8cfac req-eb7580c8-c1a7-46cf-bd1b-87bbb6767c8f service nova] Creating event network-changed:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:37:17 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-564d1526-1eba-4f62-90b7-f37efec8cfac req-eb7580c8-c1a7-46cf-bd1b-87bbb6767c8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032076 Apr 20 10:37:17 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 96/284] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-05dd9862-68d2-4e0e-a82d-225d15ed6ae7 req-6d6104fc-a4a8-4e74-81a1-62b8ba2cc741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-plugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-05dd9862-68d2-4e0e-a82d-225d15ed6ae7 req-6d6104fc-a4a8-4e74-81a1-62b8ba2cc741 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-05dd9862-68d2-4e0e-a82d-225d15ed6ae7 req-6d6104fc-a4a8-4e74-81a1-62b8ba2cc741 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-05dd9862-68d2-4e0e-a82d-225d15ed6ae7 req-6d6104fc-a4a8-4e74-81a1-62b8ba2cc741 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-05dd9862-68d2-4e0e-a82d-225d15ed6ae7 req-6d6104fc-a4a8-4e74-81a1-62b8ba2cc741 service nova] Creating event network-vif-plugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:37:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-05dd9862-68d2-4e0e-a82d-225d15ed6ae7 req-6d6104fc-a4a8-4e74-81a1-62b8ba2cc741 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035914 Apr 20 10:37:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 96/285] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:37:21 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-084bb752-ca30-4a20-9c35-0f04c0bcaac1 tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 204 len: 0 microversion: 2.1 time: 0.113064 Apr 20 10:37:21 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 94/286] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:37:21 2023] DELETE /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:21 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5470a076e14c218cf04fad713ce074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d9c5dd66fd0496a8e92b41d98fe1727', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:37:21 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e65558e0-bd2e-49ea-9b51-b95f1e96c21f tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 200 len: 1664 microversion: 2.1 time: 0.214292 Apr 20 10:37:21 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:37:21 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:37:21 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-99e53c9f-a6ea-4542-bc0d-cde2e7b4e6bf req-857ac03a-55d1-4b53-bd36-8754b52ead91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-plugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-99e53c9f-a6ea-4542-bc0d-cde2e7b4e6bf req-857ac03a-55d1-4b53-bd36-8754b52ead91 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-99e53c9f-a6ea-4542-bc0d-cde2e7b4e6bf req-857ac03a-55d1-4b53-bd36-8754b52ead91 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-99e53c9f-a6ea-4542-bc0d-cde2e7b4e6bf req-857ac03a-55d1-4b53-bd36-8754b52ead91 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-99e53c9f-a6ea-4542-bc0d-cde2e7b4e6bf req-857ac03a-55d1-4b53-bd36-8754b52ead91 service nova] Creating event network-vif-plugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:37:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-99e53c9f-a6ea-4542-bc0d-cde2e7b4e6bf req-857ac03a-55d1-4b53-bd36-8754b52ead91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027877 Apr 20 10:37:21 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:21 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-98e50c6b-0c12-435e-ab9e-02b78e0ece86 req-728e1139-3fe7-4e64-98fe-901fce0c5a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fb0d55-ef35-4386-86fe-00775b83a8d4", "name": "network-vif-unplugged", "status": "completed", "tag": "851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-98e50c6b-0c12-435e-ab9e-02b78e0ece86 req-728e1139-3fe7-4e64-98fe-901fce0c5a3d service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-98e50c6b-0c12-435e-ab9e-02b78e0ece86 req-728e1139-3fe7-4e64-98fe-901fce0c5a3d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:22 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-98e50c6b-0c12-435e-ab9e-02b78e0ece86 req-728e1139-3fe7-4e64-98fe-901fce0c5a3d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:22 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-98e50c6b-0c12-435e-ab9e-02b78e0ece86 req-728e1139-3fe7-4e64-98fe-901fce0c5a3d service nova] Creating event network-vif-unplugged:851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1 for instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 on user Apr 20 10:37:22 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-98e50c6b-0c12-435e-ab9e-02b78e0ece86 req-728e1139-3fe7-4e64-98fe-901fce0c5a3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041417 Apr 20 10:37:22 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 95/289] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:24 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-91043abc-1e11-4631-8758-8bedbdbf647a req-7d6134cb-91f1-4bb2-9e2b-5b987c54b375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64fb0d55-ef35-4386-86fe-00775b83a8d4", "name": "network-vif-plugged", "status": "completed", "tag": "851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1"}, {"server_uuid": "64fb0d55-ef35-4386-86fe-00775b83a8d4", "name": "network-vif-deleted", "tag": "851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:24 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-91043abc-1e11-4631-8758-8bedbdbf647a req-7d6134cb-91f1-4bb2-9e2b-5b987c54b375 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-91043abc-1e11-4631-8758-8bedbdbf647a req-7d6134cb-91f1-4bb2-9e2b-5b987c54b375 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-91043abc-1e11-4631-8758-8bedbdbf647a req-7d6134cb-91f1-4bb2-9e2b-5b987c54b375 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:24 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-91043abc-1e11-4631-8758-8bedbdbf647a req-7d6134cb-91f1-4bb2-9e2b-5b987c54b375 service nova] Creating event network-vif-plugged:851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1 for instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 on user Apr 20 10:37:24 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-91043abc-1e11-4631-8758-8bedbdbf647a req-7d6134cb-91f1-4bb2-9e2b-5b987c54b375 service nova] Creating event network-vif-deleted:851e6a9d-9d4a-461c-b0c1-a7233bd9a8d1 for instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 on user Apr 20 10:37:24 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-91043abc-1e11-4631-8758-8bedbdbf647a req-7d6134cb-91f1-4bb2-9e2b-5b987c54b375 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035976 Apr 20 10:37:24 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 98/290] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: 50cff6dc-1947-417a-8c5f-0b10de5dfd3a] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:27 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] HTTP exception thrown: Instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a could not be found. Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Request method failure captured: Apr 20 10:37:27 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a HTTP/1.1 Apr 20 10:37:27 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:37:27 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:37:27 user devstack@n-api.service[61647]: Connection: close Apr 20 10:37:27 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:37:27 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:37:27 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:37:27 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:37:27 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRSWYwLPVo1U-uZY_Xv9Ybh2m74Fa4_88_Dixt2n2KZE7tvUWzti1uzBpVhEfqBo86Vj-Aa29wIxwhrJWqSBc6V6kjQVQh-nSuKURQZI8lxES_y6uhTTykoroO3iV9ZZmLoF5CHKlage6JjaDtWtFaKw0NY0Wb0urU9wIzQtWv8fTJs Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Project-Id: d6d8880a9263444cba94725a83974403 Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-678567479 Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6d8880a9263444cba94725a83974403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6d8880a9263444cba94725a83974403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d6d8880a9263444cba94725a83974403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-678567479 Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Tenant-Id: d6d8880a9263444cba94725a83974403 Apr 20 10:37:27 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-678567479 Apr 20 10:37:27 user devstack@n-api.service[61647]: X-User: tempest-ServerRescueNegativeTestJSON-678567479-project-member Apr 20 10:37:27 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:37:27 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:37:27 user devstack@n-api.service[61647]: X-User-Id: 729f2fdafa8e471e8f0de0c8323c36b5 Apr 20 10:37:27 user devstack@n-api.service[61647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-678567479-project-member Apr 20 10:37:27 user devstack@n-api.service[61647]: method: > Apr 20 10:37:27 user devstack@n-api.service[61647]: exception: Instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a could not be found. Apr 20 10:37:27 user devstack@n-api.service[61647]: action_args: {'id': '50cff6dc-1947-417a-8c5f-0b10de5dfd3a'} Apr 20 10:37:27 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a could not be found. Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a could not be found. Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a could not be found. Apr 20 10:37:27 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:27 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Returning 404 to user: Instance 50cff6dc-1947-417a-8c5f-0b10de5dfd3a could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:37:27 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-cc3405f8-05b5-4780-9b65-38f0de5ec3e0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a" status: 404 len: 111 microversion: 2.1 time: 0.128139 Apr 20 10:37:27 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 98/291] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:37:27 2023] GET /compute/v2.1/servers/50cff6dc-1947-417a-8c5f-0b10de5dfd3a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: e1115ad2-b858-4859-b1bb-2175f7eab867] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:27 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: e1115ad2-b858-4859-b1bb-2175f7eab867] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:37:27 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-2935dc28-96d3-44e7-948e-2fc2d5454b80 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867" status: 204 len: 0 microversion: 2.1 time: 0.127832 Apr 20 10:37:27 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 96/292] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:37:27 2023] DELETE /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: e1115ad2-b858-4859-b1bb-2175f7eab867] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:27 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:28 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-a354d5bb-d55f-4c86-8e60-caf12f350c5f req-228ade6a-9d0e-42bd-9dd5-954298cb8533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1115ad2-b858-4859-b1bb-2175f7eab867", "name": "network-vif-unplugged", "status": "completed", "tag": "c47ac25a-c0d0-4443-8759-c573281b63f9"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a354d5bb-d55f-4c86-8e60-caf12f350c5f req-228ade6a-9d0e-42bd-9dd5-954298cb8533 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a354d5bb-d55f-4c86-8e60-caf12f350c5f req-228ade6a-9d0e-42bd-9dd5-954298cb8533 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a354d5bb-d55f-4c86-8e60-caf12f350c5f req-228ade6a-9d0e-42bd-9dd5-954298cb8533 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:28 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-a354d5bb-d55f-4c86-8e60-caf12f350c5f req-228ade6a-9d0e-42bd-9dd5-954298cb8533 service nova] Creating event network-vif-unplugged:c47ac25a-c0d0-4443-8759-c573281b63f9 for instance e1115ad2-b858-4859-b1bb-2175f7eab867 on user Apr 20 10:37:28 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-a354d5bb-d55f-4c86-8e60-caf12f350c5f req-228ade6a-9d0e-42bd-9dd5-954298cb8533 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039994 Apr 20 10:37:28 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 99/293] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:28 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729f2fdafa8e471e8f0de0c8323c36b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d8880a9263444cba94725a83974403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:37:28 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-02bc5bfe-c6fb-417b-a678-b0056ded500d tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867" status: 200 len: 1510 microversion: 2.1 time: 0.274798 Apr 20 10:37:28 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:37:27 2023] GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:37:30 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-08c6c40e-bd73-406b-96f9-25146247fcf7 req-7a51eaf9-2ba1-4a2c-9e90-d292d618ecec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1115ad2-b858-4859-b1bb-2175f7eab867", "name": "network-vif-plugged", "status": "completed", "tag": "c47ac25a-c0d0-4443-8759-c573281b63f9"}, {"server_uuid": "e1115ad2-b858-4859-b1bb-2175f7eab867", "name": "network-vif-deleted", "tag": "c47ac25a-c0d0-4443-8759-c573281b63f9"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-08c6c40e-bd73-406b-96f9-25146247fcf7 req-7a51eaf9-2ba1-4a2c-9e90-d292d618ecec service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-08c6c40e-bd73-406b-96f9-25146247fcf7 req-7a51eaf9-2ba1-4a2c-9e90-d292d618ecec service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-08c6c40e-bd73-406b-96f9-25146247fcf7 req-7a51eaf9-2ba1-4a2c-9e90-d292d618ecec service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:30 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-08c6c40e-bd73-406b-96f9-25146247fcf7 req-7a51eaf9-2ba1-4a2c-9e90-d292d618ecec service nova] Creating event network-vif-plugged:c47ac25a-c0d0-4443-8759-c573281b63f9 for instance e1115ad2-b858-4859-b1bb-2175f7eab867 on user Apr 20 10:37:30 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-08c6c40e-bd73-406b-96f9-25146247fcf7 req-7a51eaf9-2ba1-4a2c-9e90-d292d618ecec service nova] Creating event network-vif-deleted:c47ac25a-c0d0-4443-8759-c573281b63f9 for instance e1115ad2-b858-4859-b1bb-2175f7eab867 on user Apr 20 10:37:30 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-08c6c40e-bd73-406b-96f9-25146247fcf7 req-7a51eaf9-2ba1-4a2c-9e90-d292d618ecec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028317 Apr 20 10:37:30 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 97/295] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=12 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: 50181cb3-e752-4b72-a09d-e7fdae1edd8f] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:39 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] HTTP exception thrown: Instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f could not be found. Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Request method failure captured: Apr 20 10:37:39 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f HTTP/1.1 Apr 20 10:37:39 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:37:39 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:37:39 user devstack@n-api.service[61647]: Connection: close Apr 20 10:37:39 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:37:39 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:37:39 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:37:39 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:37:39 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRVHrQhgPNueWsV3CsstrFBSEBpal6HYbndEFtaBIspptNkR7T9eLBM4OCJgPi3p7hg6YNHSichUKm3oK7_ft1OIDOCUj3qfHwkTi7KRINE5kJkSbnVH-U01Ztc7bnQi7FznkBKGRTQatRAOfDLoZj4Hv8ajKHE-g9DeWp93CpsqZl4 Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Project-Id: 3e5913ed7eb944ddae4b38e1d746e7b9 Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Project-Name: tempest-TestMinimumBasicScenario-244367270 Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e5913ed7eb944ddae4b38e1d746e7b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e5913ed7eb944ddae4b38e1d746e7b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e5913ed7eb944ddae4b38e1d746e7b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Tenant: tempest-TestMinimumBasicScenario-244367270 Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Tenant-Id: 3e5913ed7eb944ddae4b38e1d746e7b9 Apr 20 10:37:39 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-TestMinimumBasicScenario-244367270 Apr 20 10:37:39 user devstack@n-api.service[61647]: X-User: tempest-TestMinimumBasicScenario-244367270-project-member Apr 20 10:37:39 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:37:39 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:37:39 user devstack@n-api.service[61647]: X-User-Id: 878178b690704d048c37c79d596e953b Apr 20 10:37:39 user devstack@n-api.service[61647]: X-User-Name: tempest-TestMinimumBasicScenario-244367270-project-member Apr 20 10:37:39 user devstack@n-api.service[61647]: method: > Apr 20 10:37:39 user devstack@n-api.service[61647]: exception: Instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f could not be found. Apr 20 10:37:39 user devstack@n-api.service[61647]: action_args: {'id': '50181cb3-e752-4b72-a09d-e7fdae1edd8f'} Apr 20 10:37:39 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f could not be found. Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f could not be found. Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f could not be found. Apr 20 10:37:39 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:37:39 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Returning 404 to user: Instance 50181cb3-e752-4b72-a09d-e7fdae1edd8f could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:37:39 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-85e25b00-4bda-409b-aaac-bade7f78c811 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f" status: 404 len: 111 microversion: 2.1 time: 0.032929 Apr 20 10:37:39 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:37:39 2023] GET /compute/v2.1/servers/50181cb3-e752-4b72-a09d-e7fdae1edd8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:37:39 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-a3aad642-7d38-40c1-ba1e-881f7d68f292 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '.version_select at 0x7f122a699ab0>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:39 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:39 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=16 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:39 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-a3aad642-7d38-40c1-ba1e-881f7d68f292 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-693580580" status: 202 len: 0 microversion: 2.1 time: 0.027346 Apr 20 10:37:39 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 20 10:37:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-693580580 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:37:41 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:41 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:37:41 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-dedf3ee2-d776-427c-8c94-96bee46e0b09 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Action: 'create', calling method: .version_select at 0x7f122a697a30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-956051906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6n0xssgLNJ9YwnQ9V93NcaNq9fsgPjdGXY0hrReturf7mL9Oi05p0B44KoX3tqIuN1tQo+iN1yrvDbet7dn3Flu5MucjF+Z3ihqA8dypjS6Ft9XWhbqbaTjqdOQGkwAw=="}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:41 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-dedf3ee2-d776-427c-8c94-96bee46e0b09 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:37:41 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-dedf3ee2-d776-427c-8c94-96bee46e0b09 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for user 878178b690704d048c37c79d596e953b and project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:37:41 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-dedf3ee2-d776-427c-8c94-96bee46e0b09 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051458 Apr 20 10:37:41 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 98/298] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:37:41 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1705189616", "imageRef": "69262355-7a22-44a5-8ebf-cd108cd9fd5c", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-956051906", "networks": [{"uuid": "0ebbf38f-49de-48cb-ab19-2af234cb93fc"}]}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] validate_networks() for [('0ebbf38f-49de-48cb-ab19-2af234cb93fc', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Getting quotas for user 878178b690704d048c37c79d596e953b and project 3e5913ed7eb944ddae4b38e1d746e7b9. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:37:42 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69262355-7a22-44a5-8ebf-cd108cd9fd5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:37:42 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-7e5dd0f9-febb-4069-be8c-4f34968dd8f6 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.586346 Apr 20 10:37:42 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 101/299] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:37:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:37:42 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-1929a50a-75ae-480d-ad43-eae0ef2ca053 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:37:42 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-1929a50a-75ae-480d-ad43-eae0ef2ca053 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:37:42 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-1929a50a-75ae-480d-ad43-eae0ef2ca053 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:37:42 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-1929a50a-75ae-480d-ad43-eae0ef2ca053 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d" status: 200 len: 1252 microversion: 2.1 time: 0.067120 Apr 20 10:37:42 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 101/300] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:37:42 2023] GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d => generated 1252 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:37:44 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-80a79d1f-0769-4fd5-ba38-722bea76e38b req-8d330f98-9045-450e-b38f-05cea0688f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d3f0e1-b178-4197-b40a-8ebb2548432d", "tag": "4117b617-d8de-4936-aedb-a7d408fe0b34"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-80a79d1f-0769-4fd5-ba38-722bea76e38b req-8d330f98-9045-450e-b38f-05cea0688f8f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-80a79d1f-0769-4fd5-ba38-722bea76e38b req-8d330f98-9045-450e-b38f-05cea0688f8f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:44 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-80a79d1f-0769-4fd5-ba38-722bea76e38b req-8d330f98-9045-450e-b38f-05cea0688f8f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:44 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-80a79d1f-0769-4fd5-ba38-722bea76e38b req-8d330f98-9045-450e-b38f-05cea0688f8f service nova] Creating event network-changed:4117b617-d8de-4936-aedb-a7d408fe0b34 for instance a8d3f0e1-b178-4197-b40a-8ebb2548432d on user Apr 20 10:37:44 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-80a79d1f-0769-4fd5-ba38-722bea76e38b req-8d330f98-9045-450e-b38f-05cea0688f8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029012 Apr 20 10:37:44 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 99/301] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:46 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-a229acc9-153e-4bb4-bc78-c43cf932ec6d req-817fc706-6d17-435e-8d33-36f29d97b036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d3f0e1-b178-4197-b40a-8ebb2548432d", "name": "network-vif-plugged", "status": "completed", "tag": "4117b617-d8de-4936-aedb-a7d408fe0b34"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a229acc9-153e-4bb4-bc78-c43cf932ec6d req-817fc706-6d17-435e-8d33-36f29d97b036 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a229acc9-153e-4bb4-bc78-c43cf932ec6d req-817fc706-6d17-435e-8d33-36f29d97b036 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:46 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a229acc9-153e-4bb4-bc78-c43cf932ec6d req-817fc706-6d17-435e-8d33-36f29d97b036 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:47 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-a229acc9-153e-4bb4-bc78-c43cf932ec6d req-817fc706-6d17-435e-8d33-36f29d97b036 service nova] Creating event network-vif-plugged:4117b617-d8de-4936-aedb-a7d408fe0b34 for instance a8d3f0e1-b178-4197-b40a-8ebb2548432d on user Apr 20 10:37:47 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-a229acc9-153e-4bb4-bc78-c43cf932ec6d req-817fc706-6d17-435e-8d33-36f29d97b036 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Apr 20 10:37:47 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 102/302] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:37:49 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-b2ac732d-f0e4-4658-866a-72c875335bf3 req-19ad21fa-f718-4204-a116-d078d3a539f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d3f0e1-b178-4197-b40a-8ebb2548432d", "name": "network-vif-plugged", "status": "completed", "tag": "4117b617-d8de-4936-aedb-a7d408fe0b34"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:37:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b2ac732d-f0e4-4658-866a-72c875335bf3 req-19ad21fa-f718-4204-a116-d078d3a539f5 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:37:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b2ac732d-f0e4-4658-866a-72c875335bf3 req-19ad21fa-f718-4204-a116-d078d3a539f5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:37:49 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b2ac732d-f0e4-4658-866a-72c875335bf3 req-19ad21fa-f718-4204-a116-d078d3a539f5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:37:49 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-b2ac732d-f0e4-4658-866a-72c875335bf3 req-19ad21fa-f718-4204-a116-d078d3a539f5 service nova] Creating event network-vif-plugged:4117b617-d8de-4936-aedb-a7d408fe0b34 for instance a8d3f0e1-b178-4197-b40a-8ebb2548432d on user Apr 20 10:37:49 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-b2ac732d-f0e4-4658-866a-72c875335bf3 req-19ad21fa-f718-4204-a116-d078d3a539f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 Apr 20 10:37:49 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 102/303] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:37:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:05 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:05 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-ddeaae45-784d-4f30-aa04-77618d4d7298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d" status: 200 len: 1543 microversion: 2.1 time: 0.263340 Apr 20 10:38:05 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 100/304] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:38:05 2023] GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d => generated 1543 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] [instance: 64fb0d55-ef35-4386-86fe-00775b83a8d4] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] HTTP exception thrown: Instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 could not be found. Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Request method failure captured: Apr 20 10:38:11 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 HTTP/1.1 Apr 20 10:38:11 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:38:11 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:38:11 user devstack@n-api.service[61647]: Connection: close Apr 20 10:38:11 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:38:11 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:38:11 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:38:11 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:38:11 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRPEhXN1K_CsaLiNBobd5SGEfi2AYs6N2HRBn6sVzJsyvtk2efateM5TmIpVODpJR7QI3J7XqSlQbHsX1PFrB6iggwE-Yo6X6Cv5pQAOB64ipMRjwxn9YSo8rAigUzCEGK73m5zNdfbn1-45RRtZHyx3q9oLMspU4Vy9DSA-ZFXeNnI Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Project-Id: 8d9c5dd66fd0496a8e92b41d98fe1727 Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Project-Name: tempest-ServerActionsTestJSON-692026271 Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d9c5dd66fd0496a8e92b41d98fe1727"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8d9c5dd66fd0496a8e92b41d98fe1727"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8d9c5dd66fd0496a8e92b41d98fe1727"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Tenant: tempest-ServerActionsTestJSON-692026271 Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Tenant-Id: 8d9c5dd66fd0496a8e92b41d98fe1727 Apr 20 10:38:11 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-ServerActionsTestJSON-692026271 Apr 20 10:38:11 user devstack@n-api.service[61647]: X-User: tempest-ServerActionsTestJSON-692026271-project-member Apr 20 10:38:11 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:38:11 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:38:11 user devstack@n-api.service[61647]: X-User-Id: bc5470a076e14c218cf04fad713ce074 Apr 20 10:38:11 user devstack@n-api.service[61647]: X-User-Name: tempest-ServerActionsTestJSON-692026271-project-member Apr 20 10:38:11 user devstack@n-api.service[61647]: method: > Apr 20 10:38:11 user devstack@n-api.service[61647]: exception: Instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 could not be found. Apr 20 10:38:11 user devstack@n-api.service[61647]: action_args: {'id': '64fb0d55-ef35-4386-86fe-00775b83a8d4'} Apr 20 10:38:11 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 could not be found. Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 could not be found. Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 could not be found. Apr 20 10:38:11 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:38:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Returning 404 to user: Instance 64fb0d55-ef35-4386-86fe-00775b83a8d4 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:38:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-ca06797b-4cbd-4e45-9671-b43e6e0f3c9a tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4" status: 404 len: 111 microversion: 2.1 time: 0.041809 Apr 20 10:38:11 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:38:11 2023] GET /compute/v2.1/servers/64fb0d55-ef35-4386-86fe-00775b83a8d4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:38:11 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:11 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:11 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:11 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-08aaafa6-6fd9-4548-85da-d63c0fe13d3c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] Calling method '.version_select at 0x7f122a623760>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:38:11 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-08aaafa6-6fd9-4548-85da-d63c0fe13d3c tempest-ServerActionsTestJSON-692026271 tempest-ServerActionsTestJSON-692026271-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748576161" status: 202 len: 0 microversion: 2.1 time: 0.034119 Apr 20 10:38:11 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 10:38:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748576161 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] [instance: e1115ad2-b858-4859-b1bb-2175f7eab867] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:18 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] HTTP exception thrown: Instance e1115ad2-b858-4859-b1bb-2175f7eab867 could not be found. Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Request method failure captured: Apr 20 10:38:18 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867 HTTP/1.1 Apr 20 10:38:18 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:38:18 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:38:18 user devstack@n-api.service[61648]: Connection: close Apr 20 10:38:18 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:38:18 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:38:18 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:38:18 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:38:18 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRSWYwLPVo1U-uZY_Xv9Ybh2m74Fa4_88_Dixt2n2KZE7tvUWzti1uzBpVhEfqBo86Vj-Aa29wIxwhrJWqSBc6V6kjQVQh-nSuKURQZI8lxES_y6uhTTykoroO3iV9ZZmLoF5CHKlage6JjaDtWtFaKw0NY0Wb0urU9wIzQtWv8fTJs Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Project-Id: d6d8880a9263444cba94725a83974403 Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-678567479 Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6d8880a9263444cba94725a83974403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d6d8880a9263444cba94725a83974403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d6d8880a9263444cba94725a83974403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-678567479 Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Tenant-Id: d6d8880a9263444cba94725a83974403 Apr 20 10:38:18 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-678567479 Apr 20 10:38:18 user devstack@n-api.service[61648]: X-User: tempest-ServerRescueNegativeTestJSON-678567479-project-member Apr 20 10:38:18 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:38:18 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:38:18 user devstack@n-api.service[61648]: X-User-Id: 729f2fdafa8e471e8f0de0c8323c36b5 Apr 20 10:38:18 user devstack@n-api.service[61648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-678567479-project-member Apr 20 10:38:18 user devstack@n-api.service[61648]: method: > Apr 20 10:38:18 user devstack@n-api.service[61648]: exception: Instance e1115ad2-b858-4859-b1bb-2175f7eab867 could not be found. Apr 20 10:38:18 user devstack@n-api.service[61648]: action_args: {'id': 'e1115ad2-b858-4859-b1bb-2175f7eab867'} Apr 20 10:38:18 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1115ad2-b858-4859-b1bb-2175f7eab867 could not be found. Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1115ad2-b858-4859-b1bb-2175f7eab867 could not be found. Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1115ad2-b858-4859-b1bb-2175f7eab867 could not be found. Apr 20 10:38:18 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:38:18 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] Returning 404 to user: Instance e1115ad2-b858-4859-b1bb-2175f7eab867 could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:38:18 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-a2a5e575-6215-446d-93d8-d9fba839f7b0 tempest-ServerRescueNegativeTestJSON-678567479 tempest-ServerRescueNegativeTestJSON-678567479-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867" status: 404 len: 111 microversion: 2.1 time: 0.030600 Apr 20 10:38:18 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 101/307] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:38:18 2023] GET /compute/v2.1/servers/e1115ad2-b858-4859-b1bb-2175f7eab867 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-307242091", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "48558ac2-005d-42a1-a003-2662a04d6946"}]}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] validate_networks() for [('48558ac2-005d-42a1-a003-2662a04d6946', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:38:23 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for user 1b7d729afb5942b8a1753ffaa4d5a268 and project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:38:24 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:38:24 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-39bdd54c-be93-4f24-9920-b1bc617af088 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.659963 Apr 20 10:38:24 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 104/308] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 10:38:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 10:38:24 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-9774485a-efb9-493c-bada-62428f822b61 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:38:24 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-9774485a-efb9-493c-bada-62428f822b61 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:38:24 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:38:24 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-9774485a-efb9-493c-bada-62428f822b61 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:24 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-9774485a-efb9-493c-bada-62428f822b61 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:24 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-9774485a-efb9-493c-bada-62428f822b61 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:24 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-9774485a-efb9-493c-bada-62428f822b61 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b" status: 200 len: 1394 microversion: 2.87 time: 0.080195 Apr 20 10:38:24 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:38:24 2023] GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b => generated 1394 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:38:26 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-f608079e-d72a-4d12-9626-567135acd1b3 req-65ff97a8-5f77-42e7-aced-c6104e6a4054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4277833d-7119-4772-ba6d-dfa7368a652b", "tag": "02bf30f9-074c-4a50-a4c8-d468c31067a8"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-f608079e-d72a-4d12-9626-567135acd1b3 req-65ff97a8-5f77-42e7-aced-c6104e6a4054 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-f608079e-d72a-4d12-9626-567135acd1b3 req-65ff97a8-5f77-42e7-aced-c6104e6a4054 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-f608079e-d72a-4d12-9626-567135acd1b3 req-65ff97a8-5f77-42e7-aced-c6104e6a4054 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:26 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-f608079e-d72a-4d12-9626-567135acd1b3 req-65ff97a8-5f77-42e7-aced-c6104e6a4054 service nova] Creating event network-changed:02bf30f9-074c-4a50-a4c8-d468c31067a8 for instance 4277833d-7119-4772-ba6d-dfa7368a652b on user Apr 20 10:38:26 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-f608079e-d72a-4d12-9626-567135acd1b3 req-65ff97a8-5f77-42e7-aced-c6104e6a4054 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033631 Apr 20 10:38:26 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 102/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:38:28 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-428b5992-0236-4905-9df3-b97c17346d4b req-811d5da1-af90-455c-8659-22eaeb567c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4277833d-7119-4772-ba6d-dfa7368a652b", "name": "network-vif-plugged", "status": "completed", "tag": "02bf30f9-074c-4a50-a4c8-d468c31067a8"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-428b5992-0236-4905-9df3-b97c17346d4b req-811d5da1-af90-455c-8659-22eaeb567c3e service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-428b5992-0236-4905-9df3-b97c17346d4b req-811d5da1-af90-455c-8659-22eaeb567c3e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-428b5992-0236-4905-9df3-b97c17346d4b req-811d5da1-af90-455c-8659-22eaeb567c3e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:28 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-428b5992-0236-4905-9df3-b97c17346d4b req-811d5da1-af90-455c-8659-22eaeb567c3e service nova] Creating event network-vif-plugged:02bf30f9-074c-4a50-a4c8-d468c31067a8 for instance 4277833d-7119-4772-ba6d-dfa7368a652b on user Apr 20 10:38:28 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-428b5992-0236-4905-9df3-b97c17346d4b req-811d5da1-af90-455c-8659-22eaeb567c3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037826 Apr 20 10:38:28 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 105/311] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:38:29 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e64ecac4-64b2-4dd2-a158-01420888d0a9 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Action: 'create', calling method: .version_select at 0x7f122a876440>, body: {"keypair": {"name": "tempest-keypair-890693079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhpymhd3yO1Et+0eGAwsr/GXx7RZVrMrGei6a2cvPWCyKtNLDS8f5siOp4rn0Q/jHWAzkxE2ACk5TYmPElXFB6TEwAmLrBWzrznzaospNaBLAUvu71t3e1gkhL61SXmbQ=="}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:29 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-e64ecac4-64b2-4dd2-a158-01420888d0a9 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:38:29 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-e64ecac4-64b2-4dd2-a158-01420888d0a9 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for user 0a931240713e465197b96fa84574ba23 and project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'key_pairs'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:38:29 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e64ecac4-64b2-4dd2-a158-01420888d0a9 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.109449 Apr 20 10:38:29 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 105/312] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 10:38:29 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 10:38:30 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-cc77970a-1b99-41f8-95d6-819d29b2f818 req-4afe6a05-b9b3-4237-883e-c06c12f74b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4277833d-7119-4772-ba6d-dfa7368a652b", "name": "network-vif-plugged", "status": "completed", "tag": "02bf30f9-074c-4a50-a4c8-d468c31067a8"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-cc77970a-1b99-41f8-95d6-819d29b2f818 req-4afe6a05-b9b3-4237-883e-c06c12f74b3a service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-cc77970a-1b99-41f8-95d6-819d29b2f818 req-4afe6a05-b9b3-4237-883e-c06c12f74b3a service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-cc77970a-1b99-41f8-95d6-819d29b2f818 req-4afe6a05-b9b3-4237-883e-c06c12f74b3a service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:30 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-cc77970a-1b99-41f8-95d6-819d29b2f818 req-4afe6a05-b9b3-4237-883e-c06c12f74b3a service nova] Creating event network-vif-plugged:02bf30f9-074c-4a50-a4c8-d468c31067a8 for instance 4277833d-7119-4772-ba6d-dfa7368a652b on user Apr 20 10:38:30 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-cc77970a-1b99-41f8-95d6-819d29b2f818 req-4afe6a05-b9b3-4237-883e-c06c12f74b3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034992 Apr 20 10:38:30 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 103/313] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:38:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:38:30 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-320923773", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e38408cb-95b3-47d6-8d3c-32650adda382"}], "security_groups": [{"name": "tempest-securitygroup--777076686"}], "key_name": "tempest-keypair-890693079", "user_data": "}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:30 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] validate_networks() for [('e38408cb-95b3-47d6-8d3c-32650adda382', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for user 0a931240713e465197b96fa84574ba23 and project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:38:31 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:38:31 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-24fe6e8c-b229-4c7a-98b4-1f89d46c1c5e tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.645160 Apr 20 10:38:31 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 106/314] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 10:38:30 2023] POST /compute/v2.1/servers => generated 399 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 10:38:31 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e02b258f-1959-4705-8117-b2e2a87a42b0 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:38:31 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-e02b258f-1959-4705-8117-b2e2a87a42b0 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:38:31 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-e02b258f-1959-4705-8117-b2e2a87a42b0 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:31 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-e02b258f-1959-4705-8117-b2e2a87a42b0 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:31 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-e02b258f-1959-4705-8117-b2e2a87a42b0 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:31 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e02b258f-1959-4705-8117-b2e2a87a42b0 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79" status: 200 len: 1274 microversion: 2.20 time: 0.075847 Apr 20 10:38:31 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 106/315] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:38:31 2023] GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 => generated 1274 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:33 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:38:33 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-92313b55-2f7a-4c70-a32d-db67fde783b2 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d" status: 200 len: 1535 microversion: 2.1 time: 0.788158 Apr 20 10:38:33 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 104/316] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:38:32 2023] GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d => generated 1535 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:38:34 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-671c76db-e4c1-46cf-a741-0db0af11f3ef req-eb580fcf-0a7c-4fdb-8263-dbabb9edc8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e6c1fe-e5bb-496f-90e8-c77962132b79", "tag": "3a540308-3038-45f9-89b1-b7039742888b"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-671c76db-e4c1-46cf-a741-0db0af11f3ef req-eb580fcf-0a7c-4fdb-8263-dbabb9edc8b5 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-671c76db-e4c1-46cf-a741-0db0af11f3ef req-eb580fcf-0a7c-4fdb-8263-dbabb9edc8b5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-671c76db-e4c1-46cf-a741-0db0af11f3ef req-eb580fcf-0a7c-4fdb-8263-dbabb9edc8b5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:34 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-671c76db-e4c1-46cf-a741-0db0af11f3ef req-eb580fcf-0a7c-4fdb-8263-dbabb9edc8b5 service nova] Creating event network-changed:3a540308-3038-45f9-89b1-b7039742888b for instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 on user Apr 20 10:38:34 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-671c76db-e4c1-46cf-a741-0db0af11f3ef req-eb580fcf-0a7c-4fdb-8263-dbabb9edc8b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078816 Apr 20 10:38:34 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 107/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:38:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:38:36 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-5aac5dd0-dab5-41c4-bfd9-2c7afda087bf req-53c6e195-5193-4454-9fc8-6c37ef34f7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e6c1fe-e5bb-496f-90e8-c77962132b79", "name": "network-vif-plugged", "status": "completed", "tag": "3a540308-3038-45f9-89b1-b7039742888b"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:36 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-5aac5dd0-dab5-41c4-bfd9-2c7afda087bf req-53c6e195-5193-4454-9fc8-6c37ef34f7b3 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:36 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-5aac5dd0-dab5-41c4-bfd9-2c7afda087bf req-53c6e195-5193-4454-9fc8-6c37ef34f7b3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:36 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-5aac5dd0-dab5-41c4-bfd9-2c7afda087bf req-53c6e195-5193-4454-9fc8-6c37ef34f7b3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:36 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-5aac5dd0-dab5-41c4-bfd9-2c7afda087bf req-53c6e195-5193-4454-9fc8-6c37ef34f7b3 service nova] Creating event network-vif-plugged:3a540308-3038-45f9-89b1-b7039742888b for instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 on user Apr 20 10:38:36 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-5aac5dd0-dab5-41c4-bfd9-2c7afda087bf req-53c6e195-5193-4454-9fc8-6c37ef34f7b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087369 Apr 20 10:38:36 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 107/318] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:38:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:38:38 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-c48e9598-e428-45e6-874d-c8eb76705303 req-73c18bff-4e29-447e-afec-29412850cd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e6c1fe-e5bb-496f-90e8-c77962132b79", "name": "network-vif-plugged", "status": "completed", "tag": "3a540308-3038-45f9-89b1-b7039742888b"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:38:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-c48e9598-e428-45e6-874d-c8eb76705303 req-73c18bff-4e29-447e-afec-29412850cd2d service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:38:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-c48e9598-e428-45e6-874d-c8eb76705303 req-73c18bff-4e29-447e-afec-29412850cd2d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:38:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-c48e9598-e428-45e6-874d-c8eb76705303 req-73c18bff-4e29-447e-afec-29412850cd2d service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:38:38 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-c48e9598-e428-45e6-874d-c8eb76705303 req-73c18bff-4e29-447e-afec-29412850cd2d service nova] Creating event network-vif-plugged:3a540308-3038-45f9-89b1-b7039742888b for instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 on user Apr 20 10:38:38 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-c48e9598-e428-45e6-874d-c8eb76705303 req-73c18bff-4e29-447e-afec-29412850cd2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027806 Apr 20 10:38:38 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 105/319] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:38:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=12 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=8 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:05 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:05 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-3c4c5949-b1b3-46fb-ab3c-fec6a349a60c tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.257842 Apr 20 10:39:05 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 10:39:05 2023] GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d/os-interface => generated 282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:06 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=8 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:06 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:06 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:06 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-35b43a8f-5012-438d-9430-8d3ba9a7c6cb req-d2b4a407-37ae-4e5e-b378-c964507e8daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:39:06 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-35b43a8f-5012-438d-9430-8d3ba9a7c6cb req-d2b4a407-37ae-4e5e-b378-c964507e8daf service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:06 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-35b43a8f-5012-438d-9430-8d3ba9a7c6cb req-d2b4a407-37ae-4e5e-b378-c964507e8daf service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:06 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-35b43a8f-5012-438d-9430-8d3ba9a7c6cb req-d2b4a407-37ae-4e5e-b378-c964507e8daf service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:06 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-35b43a8f-5012-438d-9430-8d3ba9a7c6cb req-d2b4a407-37ae-4e5e-b378-c964507e8daf service nova] Creating event network-changed:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:06 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-35b43a8f-5012-438d-9430-8d3ba9a7c6cb req-d2b4a407-37ae-4e5e-b378-c964507e8daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038310 Apr 20 10:39:06 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:39:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=10 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=14 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:06 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:06 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-e1d0cabc-1a03-4222-9795-a097db25494e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d/ips" status: 200 len: 107 microversion: 2.1 time: 0.051709 Apr 20 10:39:06 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 106/322] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:39:06 2023] GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d/ips => generated 107 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:08 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Going to try to terminate instance {{(pid=61647) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:39:08 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-e07e4309-287e-4134-bb8d-87606aed676f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d" status: 204 len: 0 microversion: 2.1 time: 0.111255 Apr 20 10:39:08 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:39:08 2023] DELETE /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:08 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-064c799d-4cde-4969-9000-24b0ac5683c7 req-0bc1c7be-3e42-4038-9a8a-8d805e7914c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-unplugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:39:08 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a04be58cd354d508616edd9d5eeff54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e621999b00481c839affc4e83ce37c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-064c799d-4cde-4969-9000-24b0ac5683c7 req-0bc1c7be-3e42-4038-9a8a-8d805e7914c3 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-064c799d-4cde-4969-9000-24b0ac5683c7 req-0bc1c7be-3e42-4038-9a8a-8d805e7914c3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-064c799d-4cde-4969-9000-24b0ac5683c7 req-0bc1c7be-3e42-4038-9a8a-8d805e7914c3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:08 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-4defc330-80dc-4067-a4de-83662e3f8c94 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d" status: 200 len: 1667 microversion: 2.1 time: 0.251607 Apr 20 10:39:08 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:08 2023] GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d => generated 1667 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:39:08 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-064c799d-4cde-4969-9000-24b0ac5683c7 req-0bc1c7be-3e42-4038-9a8a-8d805e7914c3 service nova] Creating event network-vif-unplugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:08 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-064c799d-4cde-4969-9000-24b0ac5683c7 req-0bc1c7be-3e42-4038-9a8a-8d805e7914c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038946 Apr 20 10:39:08 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 107/325] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:39:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 10:39:09 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-862960d5-980e-43f7-b3ed-9c5a75fe4908 req-2b31b428-0163-4768-bfd5-841946514847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-deleted", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:39:09 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-862960d5-980e-43f7-b3ed-9c5a75fe4908 req-2b31b428-0163-4768-bfd5-841946514847 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:09 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-862960d5-980e-43f7-b3ed-9c5a75fe4908 req-2b31b428-0163-4768-bfd5-841946514847 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:09 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-862960d5-980e-43f7-b3ed-9c5a75fe4908 req-2b31b428-0163-4768-bfd5-841946514847 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:09 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-862960d5-980e-43f7-b3ed-9c5a75fe4908 req-2b31b428-0163-4768-bfd5-841946514847 service nova] Creating event network-vif-deleted:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:09 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-862960d5-980e-43f7-b3ed-9c5a75fe4908 req-2b31b428-0163-4768-bfd5-841946514847 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Apr 20 10:39:09 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 110/326] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:39:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:10 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-plugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}, {"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-plugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}, {"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-plugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}, {"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-unplugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}, {"server_uuid": "baecb573-a3f1-42db-bc1b-788220753a7d", "name": "network-vif-plugged", "status": "completed", "tag": "79499d87-7e81-458e-ac87-ddde51eaefc6"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:39:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:10 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Creating event network-vif-plugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Creating event network-vif-plugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Creating event network-vif-plugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Creating event network-vif-unplugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] Creating event network-vif-plugged:79499d87-7e81-458e-ac87-ddde51eaefc6 for instance baecb573-a3f1-42db-bc1b-788220753a7d on user Apr 20 10:39:10 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-0e37d4f7-8961-45c3-b588-773a755f7f13 req-3ec38e1b-f29c-4228-b4b2-d4f77637c78b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030514 Apr 20 10:39:10 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:39:10 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:14 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:14 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-cce961b9-bd51-4b21-a7e9-ce3491b85c5e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b" status: 200 len: 1690 microversion: 2.87 time: 0.261819 Apr 20 10:39:14 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 108/328] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:39:14 2023] GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b => generated 1690 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:21 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-5b34e172-085a-4cc4-b0ce-42397d269fc4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79" status: 200 len: 1585 microversion: 2.20 time: 0.267067 Apr 20 10:39:21 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 111/329] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:39:21 2023] GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 => generated 1585 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=10 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:33 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:33 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-80aede82-9f82-45a1-a46a-9e96f9344e1d tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d" status: 200 len: 1535 microversion: 2.1 time: 0.280321 Apr 20 10:39:33 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:33 2023] GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d => generated 1535 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Searching by: {'deleted': False, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9'} {{(pid=61648) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=12 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=8 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:34 user devstack@n-api.service[61648]: DEBUG nova.compute.multi_cell_list [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61648) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 10:39:34 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-a2b3b885-fcbe-4849-9892-bc40ce0a6795 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.248099 Apr 20 10:39:34 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 109/331] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 10:39:33 2023] GET /compute/v2.1/servers => generated 341 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:34 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:34 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-4ecb7e01-1e52-4df1-b4cc-a6c54feee4d1 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d" status: 200 len: 1535 microversion: 2.1 time: 0.146813 Apr 20 10:39:34 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 112/332] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:34 2023] GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d => generated 1535 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:35 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:39:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-78db93a4-bbc3-416f-982a-b0a8b1d2b358 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d" status: 204 len: 0 microversion: 2.1 time: 0.108813 Apr 20 10:39:35 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:39:35 2023] DELETE /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:35 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:36 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-5b22e728-3136-4aa2-b39b-005008ad3959 req-56570b9c-9408-49c2-af77-78f795cafed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d3f0e1-b178-4197-b40a-8ebb2548432d", "name": "network-vif-unplugged", "status": "completed", "tag": "4117b617-d8de-4936-aedb-a7d408fe0b34"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:39:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-5b22e728-3136-4aa2-b39b-005008ad3959 req-56570b9c-9408-49c2-af77-78f795cafed8 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-5b22e728-3136-4aa2-b39b-005008ad3959 req-56570b9c-9408-49c2-af77-78f795cafed8 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:36 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-5b22e728-3136-4aa2-b39b-005008ad3959 req-56570b9c-9408-49c2-af77-78f795cafed8 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:36 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-5b22e728-3136-4aa2-b39b-005008ad3959 req-56570b9c-9408-49c2-af77-78f795cafed8 service nova] Creating event network-vif-unplugged:4117b617-d8de-4936-aedb-a7d408fe0b34 for instance a8d3f0e1-b178-4197-b40a-8ebb2548432d on user Apr 20 10:39:36 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-5b22e728-3136-4aa2-b39b-005008ad3959 req-56570b9c-9408-49c2-af77-78f795cafed8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032453 Apr 20 10:39:36 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 113/334] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:39:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:36 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878178b690704d048c37c79d596e953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e5913ed7eb944ddae4b38e1d746e7b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:39:36 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-0e5f2710-9d4a-4c50-bcc6-4166743e50c8 tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d" status: 200 len: 1541 microversion: 2.1 time: 0.414218 Apr 20 10:39:36 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 110/335] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:35 2023] GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d => generated 1541 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:39:38 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-20fdb219-ba26-4e81-9a94-de8192aea508 req-3d25f1e8-7790-42d9-ad58-d6e153e7987c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d3f0e1-b178-4197-b40a-8ebb2548432d", "name": "network-vif-plugged", "status": "completed", "tag": "4117b617-d8de-4936-aedb-a7d408fe0b34"}, {"server_uuid": "a8d3f0e1-b178-4197-b40a-8ebb2548432d", "name": "network-vif-deleted", "tag": "4117b617-d8de-4936-aedb-a7d408fe0b34"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:39:38 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-20fdb219-ba26-4e81-9a94-de8192aea508 req-3d25f1e8-7790-42d9-ad58-d6e153e7987c service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:38 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-20fdb219-ba26-4e81-9a94-de8192aea508 req-3d25f1e8-7790-42d9-ad58-d6e153e7987c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:38 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-20fdb219-ba26-4e81-9a94-de8192aea508 req-3d25f1e8-7790-42d9-ad58-d6e153e7987c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:38 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-20fdb219-ba26-4e81-9a94-de8192aea508 req-3d25f1e8-7790-42d9-ad58-d6e153e7987c service nova] Creating event network-vif-plugged:4117b617-d8de-4936-aedb-a7d408fe0b34 for instance a8d3f0e1-b178-4197-b40a-8ebb2548432d on user Apr 20 10:39:38 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-20fdb219-ba26-4e81-9a94-de8192aea508 req-3d25f1e8-7790-42d9-ad58-d6e153e7987c service nova] Creating event network-vif-deleted:4117b617-d8de-4936-aedb-a7d408fe0b34 for instance a8d3f0e1-b178-4197-b40a-8ebb2548432d on user Apr 20 10:39:38 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-20fdb219-ba26-4e81-9a94-de8192aea508 req-3d25f1e8-7790-42d9-ad58-d6e153e7987c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035943 Apr 20 10:39:38 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 113/336] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:39:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=8 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:58 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:39:58 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d HTTP/1.1 Apr 20 10:39:58 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:39:58 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:39:58 user devstack@n-api.service[61647]: Connection: close Apr 20 10:39:58 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:39:58 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:39:58 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:39:58 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:39:58 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:58 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:58 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:58 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:39:58 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:39:58 user devstack@n-api.service[61647]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:39:58 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:58 user devstack@n-api.service[61647]: method: > Apr 20 10:39:58 user devstack@n-api.service[61647]: exception: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:58 user devstack@n-api.service[61647]: action_args: {'id': 'baecb573-a3f1-42db-bc1b-788220753a7d'} Apr 20 10:39:58 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:58 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:58 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:39:58 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-11a9a40c-738f-4a04-8ff6-da9d72451476 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d" status: 404 len: 111 microversion: 2.1 time: 0.034127 Apr 20 10:39:58 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 114/337] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:58 2023] GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:39:58 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-c05de3d3-2e1c-4a09-a4ee-f74dae5e300e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '.version_select at 0x7f122a6ed630>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:58 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:58 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:58 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=14 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:58 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-c05de3d3-2e1c-4a09-a4ee-f74dae5e300e tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58831496" status: 202 len: 0 microversion: 2.1 time: 0.035114 Apr 20 10:39:58 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 111/338] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 10:39:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58831496 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:39:59 user devstack@n-api.service[61649]: request: DELETE /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d HTTP/1.1 Apr 20 10:39:59 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:39:59 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:39:59 user devstack@n-api.service[61649]: Connection: close Apr 20 10:39:59 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:39:59 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:39:59 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:39:59 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:39:59 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61649]: method: > Apr 20 10:39:59 user devstack@n-api.service[61649]: exception: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: action_args: {'id': 'baecb573-a3f1-42db-bc1b-788220753a7d'} Apr 20 10:39:59 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:39:59 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-9b040900-25dd-4f06-934a-48b37d517796 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d" status: 404 len: 111 microversion: 2.1 time: 0.038573 Apr 20 10:39:59 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 114/339] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:39:59 2023] DELETE /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: baecb573-a3f1-42db-bc1b-788220753a7d] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:39:59 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d HTTP/1.1 Apr 20 10:39:59 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:39:59 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:39:59 user devstack@n-api.service[61647]: Connection: close Apr 20 10:39:59 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:39:59 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:39:59 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:39:59 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:39:59 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61647]: method: > Apr 20 10:39:59 user devstack@n-api.service[61647]: exception: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: action_args: {'id': 'baecb573-a3f1-42db-bc1b-788220753a7d'} Apr 20 10:39:59 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance baecb573-a3f1-42db-bc1b-788220753a7d could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:39:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-7c5cf181-17dd-496d-af8b-978c330e2298 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d" status: 404 len: 111 microversion: 2.1 time: 0.029064 Apr 20 10:39:59 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 115/340] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:59 2023] GET /compute/v2.1/servers/baecb573-a3f1-42db-bc1b-788220753a7d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:39:59 user devstack@n-api.service[61648]: request: DELETE /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b HTTP/1.1 Apr 20 10:39:59 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:39:59 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:39:59 user devstack@n-api.service[61648]: Connection: close Apr 20 10:39:59 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:39:59 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:39:59 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:39:59 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:39:59 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61648]: method: > Apr 20 10:39:59 user devstack@n-api.service[61648]: exception: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: action_args: {'id': '5d73c323-31d8-4695-b8e2-5826c73ebb6b'} Apr 20 10:39:59 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:39:59 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-38fab58b-1b24-422b-993c-f7d4c6f01353 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b" status: 404 len: 111 microversion: 2.1 time: 0.027692 Apr 20 10:39:59 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 112/341] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:39:59 2023] DELETE /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 5d73c323-31d8-4695-b8e2-5826c73ebb6b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:39:59 user devstack@n-api.service[61649]: request: GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b HTTP/1.1 Apr 20 10:39:59 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:39:59 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:39:59 user devstack@n-api.service[61649]: Connection: close Apr 20 10:39:59 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:39:59 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:39:59 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:39:59 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:39:59 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:39:59 user devstack@n-api.service[61649]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61649]: method: > Apr 20 10:39:59 user devstack@n-api.service[61649]: exception: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: action_args: {'id': '5d73c323-31d8-4695-b8e2-5826c73ebb6b'} Apr 20 10:39:59 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. Apr 20 10:39:59 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance 5d73c323-31d8-4695-b8e2-5826c73ebb6b could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:39:59 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-7d4397dc-a0a3-4640-bcd4-0ce3e6afd08f tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b" status: 404 len: 111 microversion: 2.1 time: 0.038078 Apr 20 10:39:59 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 115/342] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:59 2023] GET /compute/v2.1/servers/5d73c323-31d8-4695-b8e2-5826c73ebb6b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:39:59 user devstack@n-api.service[61647]: request: DELETE /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 HTTP/1.1 Apr 20 10:39:59 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:39:59 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:39:59 user devstack@n-api.service[61647]: Connection: close Apr 20 10:39:59 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:39:59 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:39:59 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:39:59 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:39:59 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:39:59 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61647]: method: > Apr 20 10:39:59 user devstack@n-api.service[61647]: exception: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: action_args: {'id': '319eafd3-e6ac-4fcc-92b1-a5f4e60952e8'} Apr 20 10:39:59 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:39:59 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-909a7305-548a-44ec-a328-b27b6fe05851 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8" status: 404 len: 111 microversion: 2.1 time: 0.025970 Apr 20 10:39:59 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 116/343] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:39:59 2023] DELETE /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] [instance: 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:39:59 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] HTTP exception thrown: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Request method failure captured: Apr 20 10:39:59 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 HTTP/1.1 Apr 20 10:39:59 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:39:59 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:39:59 user devstack@n-api.service[61648]: Connection: close Apr 20 10:39:59 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:39:59 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:39:59 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:39:59 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:39:59 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRSKtPvjS88IzAYid-z1S9_Gj7zTAQPOhxu-LUwPwfug3RtXUh8Iji4NuBid7DEYUgWD7w6IRk4AqnTv-lbzeJGBqowkC39LwYVFFaavG0cPRG-gj8KA6QWQ3U5hLLcEC3xR0Xu7EbS-faPz9FLtoL9xDqjJ4SxrOcpuUs30_lacpsk Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12e621999b00481c839affc4e83ce37c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12e621999b00481c839affc4e83ce37c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Tenant: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Tenant-Id: 12e621999b00481c839affc4e83ce37c Apr 20 10:39:59 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1619866573 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Id: 2a04be58cd354d508616edd9d5eeff54 Apr 20 10:39:59 user devstack@n-api.service[61648]: X-User-Name: tempest-AttachVolumeNegativeTest-1619866573-project-member Apr 20 10:39:59 user devstack@n-api.service[61648]: method: > Apr 20 10:39:59 user devstack@n-api.service[61648]: exception: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: action_args: {'id': '319eafd3-e6ac-4fcc-92b1-a5f4e60952e8'} Apr 20 10:39:59 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. Apr 20 10:39:59 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:39:59 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] Returning 404 to user: Instance 319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:39:59 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-48dea999-5268-4a8b-8c70-8e3da3333c76 tempest-AttachVolumeNegativeTest-1619866573 tempest-AttachVolumeNegativeTest-1619866573-project-member] 10.0.0.210 "GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8" status: 404 len: 111 microversion: 2.1 time: 0.029691 Apr 20 10:39:59 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 113/344] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:39:59 2023] GET /compute/v2.1/servers/319eafd3-e6ac-4fcc-92b1-a5f4e60952e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1746707564"}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-98da34b0-27c2-4f18-bf2e-e302293e3be3 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b/action" status: 202 len: 52 microversion: 2.87 time: 0.816510 Apr 20 10:40:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 116/345] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 10:40:14 2023] POST /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b/action => generated 52 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:40:20 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:40:20 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-1aad2414-e5f2-459d-a250-612b6416ebb7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b" status: 200 len: 1690 microversion: 2.87 time: 0.284360 Apr 20 10:40:20 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 117/346] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:40:20 2023] GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b => generated 1690 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:22 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-ddcf976c-3f1f-4cff-9c68-e02dd74311cd tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.182022 Apr 20 10:40:22 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 114/347] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 10:40:21 2023] GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79/os-interface => generated 282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:40:22 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-31557b91-804b-4280-92c7-e29e8b359df2 req-e256066a-b09e-4684-8c6a-75e0061c1718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e6c1fe-e5bb-496f-90e8-c77962132b79", "tag": "3a540308-3038-45f9-89b1-b7039742888b"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:40:23 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-31557b91-804b-4280-92c7-e29e8b359df2 req-e256066a-b09e-4684-8c6a-75e0061c1718 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:23 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-31557b91-804b-4280-92c7-e29e8b359df2 req-e256066a-b09e-4684-8c6a-75e0061c1718 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:23 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-31557b91-804b-4280-92c7-e29e8b359df2 req-e256066a-b09e-4684-8c6a-75e0061c1718 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:23 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-31557b91-804b-4280-92c7-e29e8b359df2 req-e256066a-b09e-4684-8c6a-75e0061c1718 service nova] Creating event network-changed:3a540308-3038-45f9-89b1-b7039742888b for instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 on user Apr 20 10:40:23 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-31557b91-804b-4280-92c7-e29e8b359df2 req-e256066a-b09e-4684-8c6a-75e0061c1718 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029455 Apr 20 10:40:23 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:23 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-72d004ad-7894-4cea-ad3c-55c7eb84aeeb tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79/ips" status: 200 len: 110 microversion: 2.20 time: 0.061416 Apr 20 10:40:23 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 118/349] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 10:40:23 2023] GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79/ips => generated 110 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:24 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:40:24 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-355e8166-fc8a-4e20-bb5d-fb16b0278a13 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79" status: 204 len: 0 microversion: 2.20 time: 0.126350 Apr 20 10:40:24 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 115/350] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:40:24 2023] DELETE /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:24 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:25 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-a8420921-f5ac-4cdd-977f-dcf55ddc30da req-e43e9d94-f60a-42c5-af1f-f7c19102daef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e6c1fe-e5bb-496f-90e8-c77962132b79", "name": "network-vif-unplugged", "status": "completed", "tag": "3a540308-3038-45f9-89b1-b7039742888b"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:40:25 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a8420921-f5ac-4cdd-977f-dcf55ddc30da req-e43e9d94-f60a-42c5-af1f-f7c19102daef service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:25 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a8420921-f5ac-4cdd-977f-dcf55ddc30da req-e43e9d94-f60a-42c5-af1f-f7c19102daef service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:25 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a8420921-f5ac-4cdd-977f-dcf55ddc30da req-e43e9d94-f60a-42c5-af1f-f7c19102daef service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:25 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-a8420921-f5ac-4cdd-977f-dcf55ddc30da req-e43e9d94-f60a-42c5-af1f-f7c19102daef service nova] Creating event network-vif-unplugged:3a540308-3038-45f9-89b1-b7039742888b for instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 on user Apr 20 10:40:25 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-a8420921-f5ac-4cdd-977f-dcf55ddc30da req-e43e9d94-f60a-42c5-af1f-f7c19102daef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030036 Apr 20 10:40:25 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 119/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:40:25 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:40:25 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:40:25 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:40:25 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-fa30291c-9f81-44df-9c6c-8f07233d9967 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79" status: 200 len: 1710 microversion: 2.20 time: 0.625543 Apr 20 10:40:25 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 118/352] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:40:24 2023] GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 => generated 1710 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:40:26 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-8fcae586-9025-41bb-8564-7f4fb8d2cab9 req-4736675e-9eb4-4389-94d0-25fe2ed2b49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e6c1fe-e5bb-496f-90e8-c77962132b79", "name": "network-vif-deleted", "tag": "3a540308-3038-45f9-89b1-b7039742888b"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:40:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-8fcae586-9025-41bb-8564-7f4fb8d2cab9 req-4736675e-9eb4-4389-94d0-25fe2ed2b49b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-8fcae586-9025-41bb-8564-7f4fb8d2cab9 req-4736675e-9eb4-4389-94d0-25fe2ed2b49b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:26 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-8fcae586-9025-41bb-8564-7f4fb8d2cab9 req-4736675e-9eb4-4389-94d0-25fe2ed2b49b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:26 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-8fcae586-9025-41bb-8564-7f4fb8d2cab9 req-4736675e-9eb4-4389-94d0-25fe2ed2b49b service nova] Creating event network-vif-deleted:3a540308-3038-45f9-89b1-b7039742888b for instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 on user Apr 20 10:40:26 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-8fcae586-9025-41bb-8564-7f4fb8d2cab9 req-4736675e-9eb4-4389-94d0-25fe2ed2b49b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029158 Apr 20 10:40:26 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 116/353] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:40:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] [instance: a8d3f0e1-b178-4197-b40a-8ebb2548432d] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:26 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] HTTP exception thrown: Instance a8d3f0e1-b178-4197-b40a-8ebb2548432d could not be found. Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Request method failure captured: Apr 20 10:40:26 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d HTTP/1.1 Apr 20 10:40:26 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:40:26 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:40:26 user devstack@n-api.service[61647]: Connection: close Apr 20 10:40:26 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:40:26 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:40:26 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:40:26 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:40:26 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRVHrQhgPNueWsV3CsstrFBSEBpal6HYbndEFtaBIspptNkR7T9eLBM4OCJgPi3p7hg6YNHSichUKm3oK7_ft1OIDOCUj3qfHwkTi7KRINE5kJkSbnVH-U01Ztc7bnQi7FznkBKGRTQatRAOfDLoZj4Hv8ajKHE-g9DeWp93CpsqZl4 Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Project-Id: 3e5913ed7eb944ddae4b38e1d746e7b9 Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Project-Name: tempest-TestMinimumBasicScenario-244367270 Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e5913ed7eb944ddae4b38e1d746e7b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3e5913ed7eb944ddae4b38e1d746e7b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3e5913ed7eb944ddae4b38e1d746e7b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Tenant: tempest-TestMinimumBasicScenario-244367270 Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Tenant-Id: 3e5913ed7eb944ddae4b38e1d746e7b9 Apr 20 10:40:26 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-TestMinimumBasicScenario-244367270 Apr 20 10:40:26 user devstack@n-api.service[61647]: X-User: tempest-TestMinimumBasicScenario-244367270-project-member Apr 20 10:40:26 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:40:26 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:40:26 user devstack@n-api.service[61647]: X-User-Id: 878178b690704d048c37c79d596e953b Apr 20 10:40:26 user devstack@n-api.service[61647]: X-User-Name: tempest-TestMinimumBasicScenario-244367270-project-member Apr 20 10:40:26 user devstack@n-api.service[61647]: method: > Apr 20 10:40:26 user devstack@n-api.service[61647]: exception: Instance a8d3f0e1-b178-4197-b40a-8ebb2548432d could not be found. Apr 20 10:40:26 user devstack@n-api.service[61647]: action_args: {'id': 'a8d3f0e1-b178-4197-b40a-8ebb2548432d'} Apr 20 10:40:26 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d3f0e1-b178-4197-b40a-8ebb2548432d could not be found. Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d3f0e1-b178-4197-b40a-8ebb2548432d could not be found. Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d3f0e1-b178-4197-b40a-8ebb2548432d could not be found. Apr 20 10:40:26 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:40:26 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Returning 404 to user: Instance a8d3f0e1-b178-4197-b40a-8ebb2548432d could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:40:26 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-b0f589ab-e44e-406a-a1b2-fd7090f4bccc tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d" status: 404 len: 111 microversion: 2.1 time: 0.239033 Apr 20 10:40:26 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 120/354] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:40:26 2023] GET /compute/v2.1/servers/a8d3f0e1-b178-4197-b40a-8ebb2548432d => generated 111 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:40:26 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-fea6c00c-5569-4b7a-8086-6e0aeba352ce tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] Calling method '.version_select at 0x7f122a876ef0>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:40:26 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-fea6c00c-5569-4b7a-8086-6e0aeba352ce tempest-TestMinimumBasicScenario-244367270 tempest-TestMinimumBasicScenario-244367270-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-956051906" status: 202 len: 0 microversion: 2.1 time: 0.021508 Apr 20 10:40:26 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 119/355] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 20 10:40:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-956051906 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:40:27 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-41c1b99e-4bea-4ba6-94a1-08ab099578b8 req-9ce1abff-ccab-4fb0-804d-d1c822be62a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e6c1fe-e5bb-496f-90e8-c77962132b79", "name": "network-vif-plugged", "status": "completed", "tag": "3a540308-3038-45f9-89b1-b7039742888b"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:40:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-41c1b99e-4bea-4ba6-94a1-08ab099578b8 req-9ce1abff-ccab-4fb0-804d-d1c822be62a9 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:40:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-41c1b99e-4bea-4ba6-94a1-08ab099578b8 req-9ce1abff-ccab-4fb0-804d-d1c822be62a9 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:40:27 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-41c1b99e-4bea-4ba6-94a1-08ab099578b8 req-9ce1abff-ccab-4fb0-804d-d1c822be62a9 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:40:27 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-41c1b99e-4bea-4ba6-94a1-08ab099578b8 req-9ce1abff-ccab-4fb0-804d-d1c822be62a9 service nova] Creating event network-vif-plugged:3a540308-3038-45f9-89b1-b7039742888b for instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 on user Apr 20 10:40:27 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-41c1b99e-4bea-4ba6-94a1-08ab099578b8 req-9ce1abff-ccab-4fb0-804d-d1c822be62a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030444 Apr 20 10:40:27 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 117/356] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:40:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=10 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=14 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:15 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] HTTP exception thrown: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Request method failure captured: Apr 20 10:41:15 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 HTTP/1.1 Apr 20 10:41:15 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:41:15 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:41:15 user devstack@n-api.service[61647]: Connection: close Apr 20 10:41:15 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:41:15 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:41:15 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:41:15 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:41:15 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRYkYM5zTu_Gw0VPhs-ysGfV5OCXhL96ez9I2uD6C3xcRlMtKscRB_NjX1-N_YZDGSBnrl-dEKjcCk1H9UB91vuDD9wnTckJFY136r1DyRFYz9BKYR2urAU_XppBWUOwnZRBAmLtnTJSPAkL3eZmjylWpLkCZHRWmOxat0pr8seT-bw Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Project-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Tenant-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:41:15 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:41:15 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:41:15 user devstack@n-api.service[61647]: X-User-Id: 0a931240713e465197b96fa84574ba23 Apr 20 10:41:15 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:41:15 user devstack@n-api.service[61647]: method: > Apr 20 10:41:15 user devstack@n-api.service[61647]: exception: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:41:15 user devstack@n-api.service[61647]: action_args: {'id': 'e1e6c1fe-e5bb-496f-90e8-c77962132b79'} Apr 20 10:41:15 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:41:15 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:41:15 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Returning 404 to user: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:41:15 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-3bd52610-f73a-4c9d-a5fa-cf29624e94e1 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79" status: 404 len: 111 microversion: 2.20 time: 0.032418 Apr 20 10:41:15 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 121/357] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:41:15 2023] GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:41:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-a0b1d6f2-e34d-430e-8ff9-9d56d5e0f569 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '.version_select at 0x7f122a551090>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:41:15 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:41:15 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:41:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-a0b1d6f2-e34d-430e-8ff9-9d56d5e0f569 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890693079" status: 204 len: 0 microversion: 2.20 time: 0.026159 Apr 20 10:41:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 120/358] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 20 10:41:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890693079 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:41:16 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:41:16 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:41:16 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-1b65c9cf-bb20-4e9a-80b0-420ec9897f3a tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Action: 'create', calling method: .version_select at 0x7f122a6eecb0>, body: {"keypair": {"name": "tempest-keypair-1124108181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGhoArKgEyYE7cjbkuljf5dfqWvULtvRqXeDkd3yU0VFytwA0oQTi1WmPBfETn5tfNR5w6ja8z1Fe252sgoGIglYuGRFBV1xpFytKMJ6xdB6Euq8vN0T70qYh0FRstlFQ=="}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:16 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-1b65c9cf-bb20-4e9a-80b0-420ec9897f3a tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:41:16 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-1b65c9cf-bb20-4e9a-80b0-420ec9897f3a tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for user 0a931240713e465197b96fa84574ba23 and project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'key_pairs'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:41:16 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-1b65c9cf-bb20-4e9a-80b0-420ec9897f3a tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056679 Apr 20 10:41:16 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 118/359] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 10:41:16 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 10:41:17 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1678979542", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e38408cb-95b3-47d6-8d3c-32650adda382"}], "security_groups": [{"name": "tempest-securitygroup--1516987525"}], "key_name": "tempest-keypair-1124108181", "user_data": "}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] validate_networks() for [('e38408cb-95b3-47d6-8d3c-32650adda382', None, None, None, None, None)] {{(pid=61647) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Flavor limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Image limits 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Flavor pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Image pref 0:0:0 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.virt.hardware [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Getting quotas for user 0a931240713e465197b96fa84574ba23 and project cb2d81481a7d4ec1b28e5377055b3ed7. Resources: {'instances', 'ram', 'cores'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Going to run 1 instances... {{(pid=61647) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:41:18 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:41:18 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-d0aca3a8-29ea-4a08-9edd-2ac46ec37e02 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.596474 Apr 20 10:41:18 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 122/360] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 10:41:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 10:41:18 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-813c878f-e7d1-4331-9841-3c0181978d58 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:41:18 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-813c878f-e7d1-4331-9841-3c0181978d58 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:41:18 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-813c878f-e7d1-4331-9841-3c0181978d58 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:41:18 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-813c878f-e7d1-4331-9841-3c0181978d58 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:41:18 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-813c878f-e7d1-4331-9841-3c0181978d58 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:41:18 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-813c878f-e7d1-4331-9841-3c0181978d58 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b" status: 200 len: 1276 microversion: 2.20 time: 0.070819 Apr 20 10:41:18 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 121/361] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:41:18 2023] GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b => generated 1276 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-172044684", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "48558ac2-005d-42a1-a003-2662a04d6946"}]}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] validate_networks() for [('48558ac2-005d-42a1-a003-2662a04d6946', None, None, None, None, None)] {{(pid=61648) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:41:21 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-f3d20162-b675-4ac6-b077-4a7e0ecb54b9 req-23817756-5328-40b9-9582-9163307568b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353f8fcd-6f6e-43e8-b46c-0258d7a6a17b", "tag": "1cf8ddec-3f1f-4db3-9dfc-fb761edd6929"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f3d20162-b675-4ac6-b077-4a7e0ecb54b9 req-23817756-5328-40b9-9582-9163307568b8 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f3d20162-b675-4ac6-b077-4a7e0ecb54b9 req-23817756-5328-40b9-9582-9163307568b8 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:21 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-f3d20162-b675-4ac6-b077-4a7e0ecb54b9 req-23817756-5328-40b9-9582-9163307568b8 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-f3d20162-b675-4ac6-b077-4a7e0ecb54b9 req-23817756-5328-40b9-9582-9163307568b8 service nova] Creating event network-changed:1cf8ddec-3f1f-4db3-9dfc-fb761edd6929 for instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b on user Apr 20 10:41:21 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-f3d20162-b675-4ac6-b077-4a7e0ecb54b9 req-23817756-5328-40b9-9582-9163307568b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027697 Apr 20 10:41:21 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 123/362] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:41:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for user 1b7d729afb5942b8a1753ffaa4d5a268 and project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Going to run 1 instances... {{(pid=61648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:41:21 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:41:22 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-ee821388-a4c2-4c00-a9d3-5a2958a81b94 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.940605 Apr 20 10:41:22 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 119/363] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 10:41:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 10:41:22 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-8b02cecc-d634-4aec-b60e-6e2cb4cb3328 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:41:22 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-8b02cecc-d634-4aec-b60e-6e2cb4cb3328 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:41:22 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-8b02cecc-d634-4aec-b60e-6e2cb4cb3328 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:41:22 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-8b02cecc-d634-4aec-b60e-6e2cb4cb3328 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:41:22 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-8b02cecc-d634-4aec-b60e-6e2cb4cb3328 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:41:22 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-8b02cecc-d634-4aec-b60e-6e2cb4cb3328 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664" status: 200 len: 1394 microversion: 2.87 time: 0.072258 Apr 20 10:41:22 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 122/364] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:41:22 2023] GET /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664 => generated 1394 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:41:23 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-8479f53c-0641-485b-a910-b1c8b8187478 req-c2633b5a-8dd8-4072-afe2-a00cf1fa720f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f8fcd-6f6e-43e8-b46c-0258d7a6a17b", "name": "network-vif-plugged", "status": "completed", "tag": "1cf8ddec-3f1f-4db3-9dfc-fb761edd6929"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-8479f53c-0641-485b-a910-b1c8b8187478 req-c2633b5a-8dd8-4072-afe2-a00cf1fa720f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-8479f53c-0641-485b-a910-b1c8b8187478 req-c2633b5a-8dd8-4072-afe2-a00cf1fa720f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-8479f53c-0641-485b-a910-b1c8b8187478 req-c2633b5a-8dd8-4072-afe2-a00cf1fa720f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:23 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-8479f53c-0641-485b-a910-b1c8b8187478 req-c2633b5a-8dd8-4072-afe2-a00cf1fa720f service nova] Creating event network-vif-plugged:1cf8ddec-3f1f-4db3-9dfc-fb761edd6929 for instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b on user Apr 20 10:41:23 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-8479f53c-0641-485b-a910-b1c8b8187478 req-c2633b5a-8dd8-4072-afe2-a00cf1fa720f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159482 Apr 20 10:41:23 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 124/365] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:41:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:41:24 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-abc8e3a3-71bb-49b7-ad97-7ccea3a51053 req-3b54f8ee-09b9-4d6c-bc08-2259ff5a97a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5b6824-153d-43ab-b274-38d733da2664", "tag": "a5802bfe-63ff-426d-b2af-149698ad1a21"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-abc8e3a3-71bb-49b7-ad97-7ccea3a51053 req-3b54f8ee-09b9-4d6c-bc08-2259ff5a97a1 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-abc8e3a3-71bb-49b7-ad97-7ccea3a51053 req-3b54f8ee-09b9-4d6c-bc08-2259ff5a97a1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:24 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-abc8e3a3-71bb-49b7-ad97-7ccea3a51053 req-3b54f8ee-09b9-4d6c-bc08-2259ff5a97a1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:24 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-abc8e3a3-71bb-49b7-ad97-7ccea3a51053 req-3b54f8ee-09b9-4d6c-bc08-2259ff5a97a1 service nova] Creating event network-changed:a5802bfe-63ff-426d-b2af-149698ad1a21 for instance 3d5b6824-153d-43ab-b274-38d733da2664 on user Apr 20 10:41:24 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-abc8e3a3-71bb-49b7-ad97-7ccea3a51053 req-3b54f8ee-09b9-4d6c-bc08-2259ff5a97a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028311 Apr 20 10:41:24 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 120/366] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:41:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:41:25 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-b2f837e9-8ca2-4ab0-a65e-63c8c211b55e req-96ed4998-b63f-4c25-b87a-89196f4f5b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f8fcd-6f6e-43e8-b46c-0258d7a6a17b", "name": "network-vif-plugged", "status": "completed", "tag": "1cf8ddec-3f1f-4db3-9dfc-fb761edd6929"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:25 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b2f837e9-8ca2-4ab0-a65e-63c8c211b55e req-96ed4998-b63f-4c25-b87a-89196f4f5b57 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:25 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b2f837e9-8ca2-4ab0-a65e-63c8c211b55e req-96ed4998-b63f-4c25-b87a-89196f4f5b57 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:25 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-b2f837e9-8ca2-4ab0-a65e-63c8c211b55e req-96ed4998-b63f-4c25-b87a-89196f4f5b57 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:25 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-b2f837e9-8ca2-4ab0-a65e-63c8c211b55e req-96ed4998-b63f-4c25-b87a-89196f4f5b57 service nova] Creating event network-vif-plugged:1cf8ddec-3f1f-4db3-9dfc-fb761edd6929 for instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b on user Apr 20 10:41:25 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-b2f837e9-8ca2-4ab0-a65e-63c8c211b55e req-96ed4998-b63f-4c25-b87a-89196f4f5b57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032142 Apr 20 10:41:25 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 123/367] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:41:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:41:27 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-274f5e0c-980a-40cf-840e-f4dd14800159 req-7752b0a1-2896-46b1-a718-bfe37f1dadb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5b6824-153d-43ab-b274-38d733da2664", "name": "network-vif-deleted", "tag": "a5802bfe-63ff-426d-b2af-149698ad1a21"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:41:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-274f5e0c-980a-40cf-840e-f4dd14800159 req-7752b0a1-2896-46b1-a718-bfe37f1dadb0 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:41:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-274f5e0c-980a-40cf-840e-f4dd14800159 req-7752b0a1-2896-46b1-a718-bfe37f1dadb0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:41:27 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-274f5e0c-980a-40cf-840e-f4dd14800159 req-7752b0a1-2896-46b1-a718-bfe37f1dadb0 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:41:27 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.compute.server_external_events [req-274f5e0c-980a-40cf-840e-f4dd14800159 req-7752b0a1-2896-46b1-a718-bfe37f1dadb0 service nova] Unable to find a host for instance 3d5b6824-153d-43ab-b274-38d733da2664. Dropping event network-vif-deleted {{(pid=61647) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 10:41:27 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-274f5e0c-980a-40cf-840e-f4dd14800159 req-7752b0a1-2896-46b1-a718-bfe37f1dadb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032290 Apr 20 10:41:27 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 125/368] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:41:27 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=10 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:08 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:09 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:09 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:09 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:09 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-d32cc503-b08b-493f-a05e-abe58d72e2fe tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b" status: 200 len: 1589 microversion: 2.20 time: 0.700733 Apr 20 10:42:09 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 121/369] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:42:08 2023] GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b => generated 1589 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.objects.instance [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lazy-loading 'fault' on Instance uuid 3d5b6824-153d-43ab-b274-38d733da2664 {{(pid=61649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:12 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-a3f7edaf-c715-4767-af7f-4baffa3dd58c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664" status: 200 len: 1649 microversion: 2.87 time: 0.156926 Apr 20 10:42:12 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 124/370] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:42:12 2023] GET /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664 => generated 1649 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=10 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Going to try to terminate instance {{(pid=61647) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Doing local delete in cell f21b7af8-f4f6-43eb-856a-0fb219d1bf22(cell1) {{(pid=61647) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61647]: WARNING nova.compute.api [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] instance's host None is down, deleting from database Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] deallocate_for_instance() {{(pid=61647) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Instance cache missing network info. {{(pid=61647) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.network.neutron [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Updating instance_info_cache with network_info: [] {{(pid=61647) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 10:42:12 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61647) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 10:42:12 user devstack@n-api.service[61647]: WARNING nova.compute.api [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 10:42:12 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-6fad9798-2259-47c6-beb6-c3aef02b6cb6 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664" status: 204 len: 0 microversion: 2.87 time: 0.497350 Apr 20 10:42:12 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 126/371] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:42:12 2023] DELETE /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 3d5b6824-153d-43ab-b274-38d733da2664] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:12 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] HTTP exception thrown: Instance 3d5b6824-153d-43ab-b274-38d733da2664 could not be found. Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Request method failure captured: Apr 20 10:42:12 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664 HTTP/1.1 Apr 20 10:42:12 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:42:12 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:42:12 user devstack@n-api.service[61648]: Connection: close Apr 20 10:42:12 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:42:12 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:42:12 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:42:12 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:42:12 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRYfTzGzgw30pkslZX6RqaWwCbA-twwgho2U3DhYLs67fxXRTKM6XzUP7GLKkowRUgzXCG389Bk7kvVhdPeRPvVYGYERzBNNVVfo8-kTrlayPAhRDEHK7W7NeVXJdsnRCMSByOuJE1NnZ4tUnatZgjTGebAlPpBhNK2TtHFl08ZopzM Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Project-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Tenant-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:42:12 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:42:12 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:42:12 user devstack@n-api.service[61648]: X-User-Id: 1b7d729afb5942b8a1753ffaa4d5a268 Apr 20 10:42:12 user devstack@n-api.service[61648]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:42:12 user devstack@n-api.service[61648]: method: > Apr 20 10:42:12 user devstack@n-api.service[61648]: exception: Instance 3d5b6824-153d-43ab-b274-38d733da2664 could not be found. Apr 20 10:42:12 user devstack@n-api.service[61648]: action_args: {'id': '3d5b6824-153d-43ab-b274-38d733da2664'} Apr 20 10:42:12 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5b6824-153d-43ab-b274-38d733da2664 could not be found. Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5b6824-153d-43ab-b274-38d733da2664 could not be found. Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5b6824-153d-43ab-b274-38d733da2664 could not be found. Apr 20 10:42:12 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:42:12 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Returning 404 to user: Instance 3d5b6824-153d-43ab-b274-38d733da2664 could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:42:12 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-a18343ba-279c-485d-8f8f-d03ff60cf563 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664" status: 404 len: 111 microversion: 2.87 time: 0.028744 Apr 20 10:42:12 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 122/372] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:42:12 2023] GET /compute/v2.1/servers/3d5b6824-153d-43ab-b274-38d733da2664 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1001420332", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "48558ac2-005d-42a1-a003-2662a04d6946"}]}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:42:12 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] validate_networks() for [('48558ac2-005d-42a1-a003-2662a04d6946', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for user 1b7d729afb5942b8a1753ffaa4d5a268 and project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:42:13 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:42:13 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-465a2883-fcae-48bb-af30-c713df9ebaea tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.620047 Apr 20 10:42:13 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 125/373] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 10:42:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 10:42:13 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-65d726cf-0d1c-4727-aafb-4dde830a3635 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:42:13 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-65d726cf-0d1c-4727-aafb-4dde830a3635 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:42:13 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-65d726cf-0d1c-4727-aafb-4dde830a3635 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:13 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-65d726cf-0d1c-4727-aafb-4dde830a3635 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:13 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-65d726cf-0d1c-4727-aafb-4dde830a3635 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:42:13 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-65d726cf-0d1c-4727-aafb-4dde830a3635 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01" status: 200 len: 1395 microversion: 2.87 time: 0.075125 Apr 20 10:42:13 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 127/374] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:42:13 2023] GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01 => generated 1395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:42:15 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-2790b7e3-a0cd-42ee-b36a-c8f350f82b60 req-44fe5e1f-94da-4f3d-b460-afa5bc212b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f950a703-4df1-432a-804c-a65807673d01", "tag": "441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:42:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-2790b7e3-a0cd-42ee-b36a-c8f350f82b60 req-44fe5e1f-94da-4f3d-b460-afa5bc212b15 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-2790b7e3-a0cd-42ee-b36a-c8f350f82b60 req-44fe5e1f-94da-4f3d-b460-afa5bc212b15 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:15 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-2790b7e3-a0cd-42ee-b36a-c8f350f82b60 req-44fe5e1f-94da-4f3d-b460-afa5bc212b15 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:15 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-2790b7e3-a0cd-42ee-b36a-c8f350f82b60 req-44fe5e1f-94da-4f3d-b460-afa5bc212b15 service nova] Creating event network-changed:441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a for instance f950a703-4df1-432a-804c-a65807673d01 on user Apr 20 10:42:15 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-2790b7e3-a0cd-42ee-b36a-c8f350f82b60 req-44fe5e1f-94da-4f3d-b460-afa5bc212b15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028886 Apr 20 10:42:15 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 123/375] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:42:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:42:17 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-900a9a8a-6211-42c4-9d1f-e1f1e27ebf2f req-c0dae935-4532-435c-8199-2b14da1da2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950a703-4df1-432a-804c-a65807673d01", "name": "network-vif-plugged", "status": "completed", "tag": "441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:42:17 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-900a9a8a-6211-42c4-9d1f-e1f1e27ebf2f req-c0dae935-4532-435c-8199-2b14da1da2b5 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:17 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-900a9a8a-6211-42c4-9d1f-e1f1e27ebf2f req-c0dae935-4532-435c-8199-2b14da1da2b5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:17 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-900a9a8a-6211-42c4-9d1f-e1f1e27ebf2f req-c0dae935-4532-435c-8199-2b14da1da2b5 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:17 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-900a9a8a-6211-42c4-9d1f-e1f1e27ebf2f req-c0dae935-4532-435c-8199-2b14da1da2b5 service nova] Creating event network-vif-plugged:441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a for instance f950a703-4df1-432a-804c-a65807673d01 on user Apr 20 10:42:17 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-900a9a8a-6211-42c4-9d1f-e1f1e27ebf2f req-c0dae935-4532-435c-8199-2b14da1da2b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029657 Apr 20 10:42:17 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 126/376] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:42:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:42:19 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-54a1b97d-4020-4c72-8997-62f2aca90d59 req-26a8b23a-f4e4-4631-9e82-85b7a2a583ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950a703-4df1-432a-804c-a65807673d01", "name": "network-vif-plugged", "status": "completed", "tag": "441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:42:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-54a1b97d-4020-4c72-8997-62f2aca90d59 req-26a8b23a-f4e4-4631-9e82-85b7a2a583ef service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:42:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-54a1b97d-4020-4c72-8997-62f2aca90d59 req-26a8b23a-f4e4-4631-9e82-85b7a2a583ef service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:42:19 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-54a1b97d-4020-4c72-8997-62f2aca90d59 req-26a8b23a-f4e4-4631-9e82-85b7a2a583ef service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:42:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-54a1b97d-4020-4c72-8997-62f2aca90d59 req-26a8b23a-f4e4-4631-9e82-85b7a2a583ef service nova] Creating event network-vif-plugged:441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a for instance f950a703-4df1-432a-804c-a65807673d01 on user Apr 20 10:42:19 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-54a1b97d-4020-4c72-8997-62f2aca90d59 req-26a8b23a-f4e4-4631-9e82-85b7a2a583ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027837 Apr 20 10:42:19 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 128/377] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:42:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=10 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:43:03 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:43:03 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-71414d92-ef16-4b42-a0a2-b492632ecbd8 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01" status: 200 len: 1690 microversion: 2.87 time: 0.233399 Apr 20 10:43:03 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 124/378] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:43:03 2023] GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=12 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:09 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:09 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-5db2b017-9064-4d4c-8cf4-5149ca603195 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.185811 Apr 20 10:43:09 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 127/379] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 10:43:09 2023] GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b/os-interface => generated 283 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:43:10 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:10 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:10 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:43:10 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-16b23295-55ec-4fcf-bf05-28f5ae9d4c84 req-9aa6d9ac-44e5-4ad8-a462-47f39b768151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353f8fcd-6f6e-43e8-b46c-0258d7a6a17b", "tag": "1cf8ddec-3f1f-4db3-9dfc-fb761edd6929"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:43:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-16b23295-55ec-4fcf-bf05-28f5ae9d4c84 req-9aa6d9ac-44e5-4ad8-a462-47f39b768151 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-16b23295-55ec-4fcf-bf05-28f5ae9d4c84 req-9aa6d9ac-44e5-4ad8-a462-47f39b768151 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:10 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-16b23295-55ec-4fcf-bf05-28f5ae9d4c84 req-9aa6d9ac-44e5-4ad8-a462-47f39b768151 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:10 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-16b23295-55ec-4fcf-bf05-28f5ae9d4c84 req-9aa6d9ac-44e5-4ad8-a462-47f39b768151 service nova] Creating event network-changed:1cf8ddec-3f1f-4db3-9dfc-fb761edd6929 for instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b on user Apr 20 10:43:10 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-16b23295-55ec-4fcf-bf05-28f5ae9d4c84 req-9aa6d9ac-44e5-4ad8-a462-47f39b768151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040383 Apr 20 10:43:10 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 129/380] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:43:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:10 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-9bf03cb2-e163-4a68-967f-85c34cd7e55c tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b/ips" status: 200 len: 111 microversion: 2.20 time: 0.036297 Apr 20 10:43:10 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 125/381] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 10:43:10 2023] GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b/ips => generated 111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:11 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:43:11 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-32521e78-cdae-400f-a677-234d1f97ed7f tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b" status: 204 len: 0 microversion: 2.20 time: 0.109812 Apr 20 10:43:11 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 128/382] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:43:11 2023] DELETE /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:11 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:12 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:43:12 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:43:12 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a931240713e465197b96fa84574ba23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2d81481a7d4ec1b28e5377055b3ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:43:12 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-0c7e783b-87ed-4a34-a1ef-65a1b80d582d tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b" status: 200 len: 1714 microversion: 2.20 time: 0.148225 Apr 20 10:43:12 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 130/383] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:43:11 2023] GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:43:12 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-56343266-5a0e-452c-8c3f-9fdf1c288e28 req-8e46bc6e-749c-41b3-9f42-65479b801332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f8fcd-6f6e-43e8-b46c-0258d7a6a17b", "name": "network-vif-unplugged", "status": "completed", "tag": "1cf8ddec-3f1f-4db3-9dfc-fb761edd6929"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:43:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-56343266-5a0e-452c-8c3f-9fdf1c288e28 req-8e46bc6e-749c-41b3-9f42-65479b801332 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-56343266-5a0e-452c-8c3f-9fdf1c288e28 req-8e46bc6e-749c-41b3-9f42-65479b801332 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:12 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-56343266-5a0e-452c-8c3f-9fdf1c288e28 req-8e46bc6e-749c-41b3-9f42-65479b801332 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:12 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-56343266-5a0e-452c-8c3f-9fdf1c288e28 req-8e46bc6e-749c-41b3-9f42-65479b801332 service nova] Creating event network-vif-unplugged:1cf8ddec-3f1f-4db3-9dfc-fb761edd6929 for instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b on user Apr 20 10:43:12 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-56343266-5a0e-452c-8c3f-9fdf1c288e28 req-8e46bc6e-749c-41b3-9f42-65479b801332 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032255 Apr 20 10:43:12 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 126/384] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:43:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:43:14 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-3c932497-aa44-41a2-8cc6-2b40da826719 req-9b08212d-259a-44d2-b625-68453da94554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353f8fcd-6f6e-43e8-b46c-0258d7a6a17b", "name": "network-vif-plugged", "status": "completed", "tag": "1cf8ddec-3f1f-4db3-9dfc-fb761edd6929"}, {"server_uuid": "353f8fcd-6f6e-43e8-b46c-0258d7a6a17b", "name": "network-vif-deleted", "tag": "1cf8ddec-3f1f-4db3-9dfc-fb761edd6929"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:43:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-3c932497-aa44-41a2-8cc6-2b40da826719 req-9b08212d-259a-44d2-b625-68453da94554 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:43:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-3c932497-aa44-41a2-8cc6-2b40da826719 req-9b08212d-259a-44d2-b625-68453da94554 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:43:14 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-3c932497-aa44-41a2-8cc6-2b40da826719 req-9b08212d-259a-44d2-b625-68453da94554 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:43:14 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-3c932497-aa44-41a2-8cc6-2b40da826719 req-9b08212d-259a-44d2-b625-68453da94554 service nova] Creating event network-vif-plugged:1cf8ddec-3f1f-4db3-9dfc-fb761edd6929 for instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b on user Apr 20 10:43:14 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-3c932497-aa44-41a2-8cc6-2b40da826719 req-9b08212d-259a-44d2-b625-68453da94554 service nova] Creating event network-vif-deleted:1cf8ddec-3f1f-4db3-9dfc-fb761edd6929 for instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b on user Apr 20 10:43:14 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-3c932497-aa44-41a2-8cc6-2b40da826719 req-9b08212d-259a-44d2-b625-68453da94554 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029002 Apr 20 10:43:14 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 129/385] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:43:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=8 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:44:02 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:44:02 user devstack@n-api.service[61647]: Thu Apr 20 10:44:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b (ip 10.0.0.210) !!! Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] HTTP exception thrown: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Request method failure captured: Apr 20 10:44:02 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b HTTP/1.1 Apr 20 10:44:02 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:44:02 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:44:02 user devstack@n-api.service[61647]: Connection: close Apr 20 10:44:02 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:44:02 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:44:02 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:44:02 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:44:02 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRYkYM5zTu_Gw0VPhs-ysGfV5OCXhL96ez9I2uD6C3xcRlMtKscRB_NjX1-N_YZDGSBnrl-dEKjcCk1H9UB91vuDD9wnTckJFY136r1DyRFYz9BKYR2urAU_XppBWUOwnZRBAmLtnTJSPAkL3eZmjylWpLkCZHRWmOxat0pr8seT-bw Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Project-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Tenant-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:02 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:44:02 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:44:02 user devstack@n-api.service[61647]: X-User-Id: 0a931240713e465197b96fa84574ba23 Apr 20 10:44:02 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:02 user devstack@n-api.service[61647]: method: > Apr 20 10:44:02 user devstack@n-api.service[61647]: exception: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:02 user devstack@n-api.service[61647]: action_args: {'id': '353f8fcd-6f6e-43e8-b46c-0258d7a6a17b'} Apr 20 10:44:02 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:02 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Returning 404 to user: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:44:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-d56f1b76-4092-40f5-993f-66594c186c93 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b" status: 404 len: 111 microversion: 2.20 time: 0.096380 Apr 20 10:44:02 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 131/386] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:44:02 2023] GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:44:02 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:44:02 user devstack@n-api.service[61648]: Thu Apr 20 10:44:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1124108181 (ip 10.0.0.210) !!! Apr 20 10:44:02 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:44:02 user devstack@n-api.service[61648]: Thu Apr 20 10:44:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1124108181 (ip 10.0.0.210) !!! Apr 20 10:44:02 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=8 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:44:02 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=12 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:44:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-4edcfb37-46f1-4698-95cd-632400d45bf9 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '.version_select at 0x7f122a6eea70>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:44:02 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-4edcfb37-46f1-4698-95cd-632400d45bf9 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124108181" status: 204 len: 0 microversion: 2.20 time: 0.038326 Apr 20 10:44:02 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 127/387] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 10:44:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124108181 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:44:03 user devstack@n-api.service[61649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:44:03 user devstack@n-api.service[61649]: Thu Apr 20 10:44:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b (ip 10.0.0.210) !!! Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] HTTP exception thrown: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Request method failure captured: Apr 20 10:44:03 user devstack@n-api.service[61649]: request: DELETE /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b HTTP/1.1 Apr 20 10:44:03 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:44:03 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:44:03 user devstack@n-api.service[61649]: Connection: close Apr 20 10:44:03 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:44:03 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:44:03 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:44:03 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:44:03 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRYkYM5zTu_Gw0VPhs-ysGfV5OCXhL96ez9I2uD6C3xcRlMtKscRB_NjX1-N_YZDGSBnrl-dEKjcCk1H9UB91vuDD9wnTckJFY136r1DyRFYz9BKYR2urAU_XppBWUOwnZRBAmLtnTJSPAkL3eZmjylWpLkCZHRWmOxat0pr8seT-bw Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Tenant-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Id: 0a931240713e465197b96fa84574ba23 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61649]: method: > Apr 20 10:44:03 user devstack@n-api.service[61649]: exception: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: action_args: {'id': '353f8fcd-6f6e-43e8-b46c-0258d7a6a17b'} Apr 20 10:44:03 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Returning 404 to user: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:44:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-91b360b8-ac5b-4c0c-8606-f93549ded8d5 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b" status: 404 len: 111 microversion: 2.20 time: 0.048595 Apr 20 10:44:03 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 130/388] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:44:03 2023] DELETE /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] HTTP exception thrown: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Request method failure captured: Apr 20 10:44:03 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b HTTP/1.1 Apr 20 10:44:03 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:44:03 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:44:03 user devstack@n-api.service[61647]: Connection: close Apr 20 10:44:03 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:44:03 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:44:03 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:44:03 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:44:03 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRYkYM5zTu_Gw0VPhs-ysGfV5OCXhL96ez9I2uD6C3xcRlMtKscRB_NjX1-N_YZDGSBnrl-dEKjcCk1H9UB91vuDD9wnTckJFY136r1DyRFYz9BKYR2urAU_XppBWUOwnZRBAmLtnTJSPAkL3eZmjylWpLkCZHRWmOxat0pr8seT-bw Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Project-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Tenant-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-User: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61647]: X-User-Id: 0a931240713e465197b96fa84574ba23 Apr 20 10:44:03 user devstack@n-api.service[61647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61647]: method: > Apr 20 10:44:03 user devstack@n-api.service[61647]: exception: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61647]: action_args: {'id': '353f8fcd-6f6e-43e8-b46c-0258d7a6a17b'} Apr 20 10:44:03 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. Apr 20 10:44:03 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Returning 404 to user: Instance 353f8fcd-6f6e-43e8-b46c-0258d7a6a17b could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:44:03 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-728eb5ec-56b0-4dac-a9fb-1bda660f43de tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b" status: 404 len: 111 microversion: 2.20 time: 0.026551 Apr 20 10:44:03 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 132/389] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:44:03 2023] GET /compute/v2.1/servers/353f8fcd-6f6e-43e8-b46c-0258d7a6a17b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] HTTP exception thrown: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Request method failure captured: Apr 20 10:44:03 user devstack@n-api.service[61648]: request: DELETE /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 HTTP/1.1 Apr 20 10:44:03 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:44:03 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:44:03 user devstack@n-api.service[61648]: Connection: close Apr 20 10:44:03 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:44:03 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:44:03 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:44:03 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:44:03 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRYkYM5zTu_Gw0VPhs-ysGfV5OCXhL96ez9I2uD6C3xcRlMtKscRB_NjX1-N_YZDGSBnrl-dEKjcCk1H9UB91vuDD9wnTckJFY136r1DyRFYz9BKYR2urAU_XppBWUOwnZRBAmLtnTJSPAkL3eZmjylWpLkCZHRWmOxat0pr8seT-bw Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Project-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Tenant-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-User: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61648]: X-User-Id: 0a931240713e465197b96fa84574ba23 Apr 20 10:44:03 user devstack@n-api.service[61648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61648]: method: > Apr 20 10:44:03 user devstack@n-api.service[61648]: exception: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61648]: action_args: {'id': 'e1e6c1fe-e5bb-496f-90e8-c77962132b79'} Apr 20 10:44:03 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Returning 404 to user: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:44:03 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-031728f3-2ff6-439c-84cf-099df97b7ec2 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79" status: 404 len: 111 microversion: 2.20 time: 0.031065 Apr 20 10:44:03 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 128/390] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:44:03 2023] DELETE /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] [instance: e1e6c1fe-e5bb-496f-90e8-c77962132b79] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] HTTP exception thrown: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Request method failure captured: Apr 20 10:44:03 user devstack@n-api.service[61649]: request: GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 HTTP/1.1 Apr 20 10:44:03 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:44:03 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:44:03 user devstack@n-api.service[61649]: Connection: close Apr 20 10:44:03 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:44:03 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:44:03 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:44:03 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:44:03 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRYkYM5zTu_Gw0VPhs-ysGfV5OCXhL96ez9I2uD6C3xcRlMtKscRB_NjX1-N_YZDGSBnrl-dEKjcCk1H9UB91vuDD9wnTckJFY136r1DyRFYz9BKYR2urAU_XppBWUOwnZRBAmLtnTJSPAkL3eZmjylWpLkCZHRWmOxat0pr8seT-bw Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb2d81481a7d4ec1b28e5377055b3ed7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Tenant-Id: cb2d81481a7d4ec1b28e5377055b3ed7 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1878611374 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Id: 0a931240713e465197b96fa84574ba23 Apr 20 10:44:03 user devstack@n-api.service[61649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1878611374-project-member Apr 20 10:44:03 user devstack@n-api.service[61649]: method: > Apr 20 10:44:03 user devstack@n-api.service[61649]: exception: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: action_args: {'id': 'e1e6c1fe-e5bb-496f-90e8-c77962132b79'} Apr 20 10:44:03 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. Apr 20 10:44:03 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:44:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] Returning 404 to user: Instance e1e6c1fe-e5bb-496f-90e8-c77962132b79 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:44:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-ea69df14-cc49-4ef3-a36e-702b0d002ca4 tempest-AttachVolumeShelveTestJSON-1878611374 tempest-AttachVolumeShelveTestJSON-1878611374-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79" status: 404 len: 111 microversion: 2.20 time: 0.025289 Apr 20 10:44:03 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 131/391] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:44:03 2023] GET /compute/v2.1/servers/e1e6c1fe-e5bb-496f-90e8-c77962132b79 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1044340514"}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:04 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:04 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-0239579b-05ff-484e-b8ad-8089da2f734a tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01/action" status: 202 len: 52 microversion: 2.87 time: 0.896886 Apr 20 10:44:04 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 133/392] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 10:44:03 2023] POST /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01/action => generated 52 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:44:10 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:44:10 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-7dbc5eb1-499c-4ecb-ac56-9c77601607dc tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01" status: 200 len: 1690 microversion: 2.87 time: 0.448807 Apr 20 10:44:10 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 129/393] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:44:10 2023] GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01 => generated 1690 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:45:10 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:45:10 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:45:10 user devstack@n-api.service[61649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:45:10 user devstack@n-api.service[61649]: Thu Apr 20 10:45:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 10:45:10 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-642328482", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "destination_type": "volume"}], "networks": [{"uuid": "48558ac2-005d-42a1-a003-2662a04d6946"}]}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:45:10 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] validate_networks() for [('48558ac2-005d-42a1-a003-2662a04d6946', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Getting quotas for user 1b7d729afb5942b8a1753ffaa4d5a268 and project 5bcb8e3930844068bd2b496914a4d764. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:45:11 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:45:11 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-60d00bd6-937d-4e6f-8953-43915a6c8a6f tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.779439 Apr 20 10:45:11 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 132/394] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 10:45:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 10:45:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:45:11 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:45:11 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:45:11 user devstack@n-api.service[61647]: Thu Apr 20 10:45:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439 (ip 10.0.0.210) !!! Apr 20 10:45:11 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-57b6e70d-b691-48eb-b42f-5087af136dfe tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:45:11 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-57b6e70d-b691-48eb-b42f-5087af136dfe tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:45:11 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-57b6e70d-b691-48eb-b42f-5087af136dfe tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:45:11 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-57b6e70d-b691-48eb-b42f-5087af136dfe tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:45:11 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-57b6e70d-b691-48eb-b42f-5087af136dfe tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:45:11 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-57b6e70d-b691-48eb-b42f-5087af136dfe tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439" status: 200 len: 1394 microversion: 2.87 time: 0.160432 Apr 20 10:45:11 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 134/395] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:45:11 2023] GET /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439 => generated 1394 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:45:13 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=8 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:45:13 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:45:13 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-fa0eb5a7-dee9-46de-8a81-30882b7ba985 req-589616ef-f422-4790-b404-c65ae1ce6151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e0e8b8-22fc-4ab2-8bff-35e203715439", "tag": "e5f8609e-9e75-41d5-901a-ed44b394d745"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:45:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-fa0eb5a7-dee9-46de-8a81-30882b7ba985 req-589616ef-f422-4790-b404-c65ae1ce6151 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:45:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-fa0eb5a7-dee9-46de-8a81-30882b7ba985 req-589616ef-f422-4790-b404-c65ae1ce6151 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:45:13 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-fa0eb5a7-dee9-46de-8a81-30882b7ba985 req-589616ef-f422-4790-b404-c65ae1ce6151 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:45:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-fa0eb5a7-dee9-46de-8a81-30882b7ba985 req-589616ef-f422-4790-b404-c65ae1ce6151 service nova] Creating event network-changed:e5f8609e-9e75-41d5-901a-ed44b394d745 for instance 23e0e8b8-22fc-4ab2-8bff-35e203715439 on user Apr 20 10:45:13 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-fa0eb5a7-dee9-46de-8a81-30882b7ba985 req-589616ef-f422-4790-b404-c65ae1ce6151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037433 Apr 20 10:45:13 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 130/396] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:45:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-4a70aae7-da87-4085-a295-b8bd0cac68de req-00e52cc2-2f5a-4346-b2f4-0edd6ecf20c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e0e8b8-22fc-4ab2-8bff-35e203715439", "name": "network-vif-deleted", "tag": "e5f8609e-9e75-41d5-901a-ed44b394d745"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:45:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-4a70aae7-da87-4085-a295-b8bd0cac68de req-00e52cc2-2f5a-4346-b2f4-0edd6ecf20c2 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:45:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-4a70aae7-da87-4085-a295-b8bd0cac68de req-00e52cc2-2f5a-4346-b2f4-0edd6ecf20c2 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:45:15 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-4a70aae7-da87-4085-a295-b8bd0cac68de req-00e52cc2-2f5a-4346-b2f4-0edd6ecf20c2 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:45:15 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.compute.server_external_events [req-4a70aae7-da87-4085-a295-b8bd0cac68de req-00e52cc2-2f5a-4346-b2f4-0edd6ecf20c2 service nova] Unable to find a host for instance 23e0e8b8-22fc-4ab2-8bff-35e203715439. Dropping event network-vif-deleted {{(pid=61649) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 10:45:15 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-4a70aae7-da87-4085-a295-b8bd0cac68de req-00e52cc2-2f5a-4346-b2f4-0edd6ecf20c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.081629 Apr 20 10:45:15 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 133/397] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG nova.objects.instance [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lazy-loading 'fault' on Instance uuid 23e0e8b8-22fc-4ab2-8bff-35e203715439 {{(pid=61647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:01 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:01 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-0e220046-4dc7-4fca-80c9-afd445ffd86c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439" status: 200 len: 1649 microversion: 2.87 time: 0.112007 Apr 20 10:46:01 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 135/398] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:46:01 2023] GET /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439 => generated 1649 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Going to try to terminate instance {{(pid=61648) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Doing local delete in cell f21b7af8-f4f6-43eb-856a-0fb219d1bf22(cell1) {{(pid=61648) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:01 user devstack@n-api.service[61648]: WARNING nova.compute.api [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] instance's host None is down, deleting from database Apr 20 10:46:01 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] deallocate_for_instance() {{(pid=61648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Instance cache missing network info. {{(pid=61648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Updating instance_info_cache with network_info: [] {{(pid=61648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61648) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 10:46:02 user devstack@n-api.service[61648]: WARNING nova.compute.api [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 10:46:02 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-04aa8d1b-3e77-4ba5-85a5-9193ae0ff92c tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439" status: 204 len: 0 microversion: 2.87 time: 0.532131 Apr 20 10:46:02 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 131/399] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:46:01 2023] DELETE /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 23e0e8b8-22fc-4ab2-8bff-35e203715439] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:02 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] HTTP exception thrown: Instance 23e0e8b8-22fc-4ab2-8bff-35e203715439 could not be found. Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Request method failure captured: Apr 20 10:46:02 user devstack@n-api.service[61649]: request: GET /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439 HTTP/1.1 Apr 20 10:46:02 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:46:02 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:46:02 user devstack@n-api.service[61649]: Connection: close Apr 20 10:46:02 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:46:02 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:46:02 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:46:02 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:46:02 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRYfTzGzgw30pkslZX6RqaWwCbA-twwgho2U3DhYLs67fxXRTKM6XzUP7GLKkowRUgzXCG389Bk7kvVhdPeRPvVYGYERzBNNVVfo8-kTrlayPAhRDEHK7W7NeVXJdsnRCMSByOuJE1NnZ4tUnatZgjTGebAlPpBhNK2TtHFl08ZopzM Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Project-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Tenant-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:46:02 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:46:02 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:46:02 user devstack@n-api.service[61649]: X-User-Id: 1b7d729afb5942b8a1753ffaa4d5a268 Apr 20 10:46:02 user devstack@n-api.service[61649]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:46:02 user devstack@n-api.service[61649]: method: > Apr 20 10:46:02 user devstack@n-api.service[61649]: exception: Instance 23e0e8b8-22fc-4ab2-8bff-35e203715439 could not be found. Apr 20 10:46:02 user devstack@n-api.service[61649]: action_args: {'id': '23e0e8b8-22fc-4ab2-8bff-35e203715439'} Apr 20 10:46:02 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e0e8b8-22fc-4ab2-8bff-35e203715439 could not be found. Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e0e8b8-22fc-4ab2-8bff-35e203715439 could not be found. Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e0e8b8-22fc-4ab2-8bff-35e203715439 could not be found. Apr 20 10:46:02 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:02 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Returning 404 to user: Instance 23e0e8b8-22fc-4ab2-8bff-35e203715439 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:46:02 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-f529a48c-1c69-4205-832a-1c15870f6668 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439" status: 404 len: 111 microversion: 2.87 time: 0.039086 Apr 20 10:46:02 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 134/400] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:46:02 2023] GET /compute/v2.1/servers/23e0e8b8-22fc-4ab2-8bff-35e203715439 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:02 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Going to try to terminate instance {{(pid=61647) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:46:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-849bddc8-6a84-4e66-a395-d20c7ad7ba27 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01" status: 204 len: 0 microversion: 2.87 time: 0.120867 Apr 20 10:46:02 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 136/401] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:46:02 2023] DELETE /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:02 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:03 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:03 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:03 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-a89b7282-c216-4e69-89d3-2d5d8dbf7f01 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01" status: 200 len: 1696 microversion: 2.87 time: 0.268010 Apr 20 10:46:03 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-5686bdfb-f26b-45d7-b336-4efe3509dc9d req-5e1d7e07-ffc3-41ca-8b44-4f10b5abe379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950a703-4df1-432a-804c-a65807673d01", "name": "network-vif-unplugged", "status": "completed", "tag": "441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:46:03 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 132/402] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:46:02 2023] GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01 => generated 1696 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:46:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-5686bdfb-f26b-45d7-b336-4efe3509dc9d req-5e1d7e07-ffc3-41ca-8b44-4f10b5abe379 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-5686bdfb-f26b-45d7-b336-4efe3509dc9d req-5e1d7e07-ffc3-41ca-8b44-4f10b5abe379 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:03 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-5686bdfb-f26b-45d7-b336-4efe3509dc9d req-5e1d7e07-ffc3-41ca-8b44-4f10b5abe379 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-5686bdfb-f26b-45d7-b336-4efe3509dc9d req-5e1d7e07-ffc3-41ca-8b44-4f10b5abe379 service nova] Creating event network-vif-unplugged:441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a for instance f950a703-4df1-432a-804c-a65807673d01 on user Apr 20 10:46:03 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-5686bdfb-f26b-45d7-b336-4efe3509dc9d req-5e1d7e07-ffc3-41ca-8b44-4f10b5abe379 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031088 Apr 20 10:46:03 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:46:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:46:03 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-04281827-5dcb-4510-bcb6-4c5d4ed11a24 req-ecc6ed3d-4998-40e1-b9a7-453ae528c9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950a703-4df1-432a-804c-a65807673d01", "name": "network-vif-deleted", "tag": "441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:46:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-04281827-5dcb-4510-bcb6-4c5d4ed11a24 req-ecc6ed3d-4998-40e1-b9a7-453ae528c9cf service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-04281827-5dcb-4510-bcb6-4c5d4ed11a24 req-ecc6ed3d-4998-40e1-b9a7-453ae528c9cf service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:03 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-04281827-5dcb-4510-bcb6-4c5d4ed11a24 req-ecc6ed3d-4998-40e1-b9a7-453ae528c9cf service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:03 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-04281827-5dcb-4510-bcb6-4c5d4ed11a24 req-ecc6ed3d-4998-40e1-b9a7-453ae528c9cf service nova] Creating event network-vif-deleted:441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a for instance f950a703-4df1-432a-804c-a65807673d01 on user Apr 20 10:46:03 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-04281827-5dcb-4510-bcb6-4c5d4ed11a24 req-ecc6ed3d-4998-40e1-b9a7-453ae528c9cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 Apr 20 10:46:03 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 137/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:46:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:46:05 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-ef8b083b-46a2-4979-b387-6e4582f1f63c req-03433176-a351-4e9c-ba73-fd84e059406e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950a703-4df1-432a-804c-a65807673d01", "name": "network-vif-plugged", "status": "completed", "tag": "441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:46:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ef8b083b-46a2-4979-b387-6e4582f1f63c req-03433176-a351-4e9c-ba73-fd84e059406e service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ef8b083b-46a2-4979-b387-6e4582f1f63c req-03433176-a351-4e9c-ba73-fd84e059406e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:05 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-ef8b083b-46a2-4979-b387-6e4582f1f63c req-03433176-a351-4e9c-ba73-fd84e059406e service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:05 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-ef8b083b-46a2-4979-b387-6e4582f1f63c req-03433176-a351-4e9c-ba73-fd84e059406e service nova] Creating event network-vif-plugged:441b9a7d-3a3d-486b-9a0e-6cb55fdcbe4a for instance f950a703-4df1-432a-804c-a65807673d01 on user Apr 20 10:46:05 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-ef8b083b-46a2-4979-b387-6e4582f1f63c req-03433176-a351-4e9c-ba73-fd84e059406e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029509 Apr 20 10:46:05 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 133/405] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:46:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: f950a703-4df1-432a-804c-a65807673d01] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] HTTP exception thrown: Instance f950a703-4df1-432a-804c-a65807673d01 could not be found. Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Request method failure captured: Apr 20 10:46:53 user devstack@n-api.service[61649]: request: GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01 HTTP/1.1 Apr 20 10:46:53 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:46:53 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:46:53 user devstack@n-api.service[61649]: Connection: close Apr 20 10:46:53 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:46:53 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:46:53 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:46:53 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:46:53 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRYfTzGzgw30pkslZX6RqaWwCbA-twwgho2U3DhYLs67fxXRTKM6XzUP7GLKkowRUgzXCG389Bk7kvVhdPeRPvVYGYERzBNNVVfo8-kTrlayPAhRDEHK7W7NeVXJdsnRCMSByOuJE1NnZ4tUnatZgjTGebAlPpBhNK2TtHFl08ZopzM Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Project-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Tenant-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:46:53 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:46:53 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:46:53 user devstack@n-api.service[61649]: X-User-Id: 1b7d729afb5942b8a1753ffaa4d5a268 Apr 20 10:46:53 user devstack@n-api.service[61649]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:46:53 user devstack@n-api.service[61649]: method: > Apr 20 10:46:53 user devstack@n-api.service[61649]: exception: Instance f950a703-4df1-432a-804c-a65807673d01 could not be found. Apr 20 10:46:53 user devstack@n-api.service[61649]: action_args: {'id': 'f950a703-4df1-432a-804c-a65807673d01'} Apr 20 10:46:53 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f950a703-4df1-432a-804c-a65807673d01 could not be found. Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f950a703-4df1-432a-804c-a65807673d01 could not be found. Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f950a703-4df1-432a-804c-a65807673d01 could not be found. Apr 20 10:46:53 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Returning 404 to user: Instance f950a703-4df1-432a-804c-a65807673d01 could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:46:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-e630bbb7-515b-40df-b340-b3a8c4e0854e tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01" status: 404 len: 111 microversion: 2.87 time: 0.043113 Apr 20 10:46:53 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 136/406] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:46:53 2023] GET /compute/v2.1/servers/f950a703-4df1-432a-804c-a65807673d01 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:53 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Going to try to terminate instance {{(pid=61647) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:46:53 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-2e89cf77-fa34-4c89-9364-7d9f7c7ef9d7 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b" status: 204 len: 0 microversion: 2.87 time: 0.115832 Apr 20 10:46:53 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 138/407] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 10:46:53 2023] DELETE /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:53 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7d729afb5942b8a1753ffaa4d5a268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcb8e3930844068bd2b496914a4d764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:46:53 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-89b852ee-039c-4b21-8cd3-d66c1b76db79 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b" status: 200 len: 1696 microversion: 2.87 time: 0.389341 Apr 20 10:46:53 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 134/408] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:46:53 2023] GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b => generated 1696 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-f95039a3-2b01-4df6-bf66-35ce1bd22e0b req-4a5cd2ed-1ea6-45b6-aaf0-a847e31cf284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4277833d-7119-4772-ba6d-dfa7368a652b", "name": "network-vif-unplugged", "status": "completed", "tag": "02bf30f9-074c-4a50-a4c8-d468c31067a8"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-f95039a3-2b01-4df6-bf66-35ce1bd22e0b req-4a5cd2ed-1ea6-45b6-aaf0-a847e31cf284 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-f95039a3-2b01-4df6-bf66-35ce1bd22e0b req-4a5cd2ed-1ea6-45b6-aaf0-a847e31cf284 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-f95039a3-2b01-4df6-bf66-35ce1bd22e0b req-4a5cd2ed-1ea6-45b6-aaf0-a847e31cf284 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-f95039a3-2b01-4df6-bf66-35ce1bd22e0b req-4a5cd2ed-1ea6-45b6-aaf0-a847e31cf284 service nova] Creating event network-vif-unplugged:02bf30f9-074c-4a50-a4c8-d468c31067a8 for instance 4277833d-7119-4772-ba6d-dfa7368a652b on user Apr 20 10:46:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-f95039a3-2b01-4df6-bf66-35ce1bd22e0b req-4a5cd2ed-1ea6-45b6-aaf0-a847e31cf284 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031940 Apr 20 10:46:53 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 137/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:46:55 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-4b669bbc-2cb5-4d7b-86e9-ac95fa26b9ad req-6c892d7b-6ffa-4cf0-b8ba-396f51d48b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4277833d-7119-4772-ba6d-dfa7368a652b", "name": "network-vif-plugged", "status": "completed", "tag": "02bf30f9-074c-4a50-a4c8-d468c31067a8"}, {"server_uuid": "4277833d-7119-4772-ba6d-dfa7368a652b", "name": "network-vif-deleted", "tag": "02bf30f9-074c-4a50-a4c8-d468c31067a8"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:46:55 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-4b669bbc-2cb5-4d7b-86e9-ac95fa26b9ad req-6c892d7b-6ffa-4cf0-b8ba-396f51d48b98 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:46:55 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-4b669bbc-2cb5-4d7b-86e9-ac95fa26b9ad req-6c892d7b-6ffa-4cf0-b8ba-396f51d48b98 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:46:55 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-4b669bbc-2cb5-4d7b-86e9-ac95fa26b9ad req-6c892d7b-6ffa-4cf0-b8ba-396f51d48b98 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:46:55 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-4b669bbc-2cb5-4d7b-86e9-ac95fa26b9ad req-6c892d7b-6ffa-4cf0-b8ba-396f51d48b98 service nova] Creating event network-vif-plugged:02bf30f9-074c-4a50-a4c8-d468c31067a8 for instance 4277833d-7119-4772-ba6d-dfa7368a652b on user Apr 20 10:46:55 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-4b669bbc-2cb5-4d7b-86e9-ac95fa26b9ad req-6c892d7b-6ffa-4cf0-b8ba-396f51d48b98 service nova] Creating event network-vif-deleted:02bf30f9-074c-4a50-a4c8-d468c31067a8 for instance 4277833d-7119-4772-ba6d-dfa7368a652b on user Apr 20 10:46:55 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-4b669bbc-2cb5-4d7b-86e9-ac95fa26b9ad req-6c892d7b-6ffa-4cf0-b8ba-396f51d48b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031019 Apr 20 10:46:55 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 139/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] [instance: 4277833d-7119-4772-ba6d-dfa7368a652b] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:47:43 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] HTTP exception thrown: Instance 4277833d-7119-4772-ba6d-dfa7368a652b could not be found. Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Request method failure captured: Apr 20 10:47:43 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b HTTP/1.1 Apr 20 10:47:43 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:47:43 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:47:43 user devstack@n-api.service[61648]: Connection: close Apr 20 10:47:43 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:47:43 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:47:43 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:47:43 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:47:43 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRYfTzGzgw30pkslZX6RqaWwCbA-twwgho2U3DhYLs67fxXRTKM6XzUP7GLKkowRUgzXCG389Bk7kvVhdPeRPvVYGYERzBNNVVfo8-kTrlayPAhRDEHK7W7NeVXJdsnRCMSByOuJE1NnZ4tUnatZgjTGebAlPpBhNK2TtHFl08ZopzM Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Project-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5bcb8e3930844068bd2b496914a4d764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Tenant-Id: 5bcb8e3930844068bd2b496914a4d764 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:47:43 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:47:43 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:47:43 user devstack@n-api.service[61648]: X-User-Id: 1b7d729afb5942b8a1753ffaa4d5a268 Apr 20 10:47:43 user devstack@n-api.service[61648]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member Apr 20 10:47:43 user devstack@n-api.service[61648]: method: > Apr 20 10:47:43 user devstack@n-api.service[61648]: exception: Instance 4277833d-7119-4772-ba6d-dfa7368a652b could not be found. Apr 20 10:47:43 user devstack@n-api.service[61648]: action_args: {'id': '4277833d-7119-4772-ba6d-dfa7368a652b'} Apr 20 10:47:43 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4277833d-7119-4772-ba6d-dfa7368a652b could not be found. Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4277833d-7119-4772-ba6d-dfa7368a652b could not be found. Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4277833d-7119-4772-ba6d-dfa7368a652b could not be found. Apr 20 10:47:43 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:47:43 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] Returning 404 to user: Instance 4277833d-7119-4772-ba6d-dfa7368a652b could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:47:43 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-7973b6fb-aa85-4d58-a31f-199dbee9d726 tempest-ServerBootFromVolumeStableRescueTest-134694710 tempest-ServerBootFromVolumeStableRescueTest-134694710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b" status: 404 len: 111 microversion: 2.87 time: 0.035609 Apr 20 10:47:43 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 135/411] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 10:47:43 2023] GET /compute/v2.1/servers/4277833d-7119-4772-ba6d-dfa7368a652b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 10:47:54 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:54 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-504126875", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "94565cf9-f25f-4733-96b4-8ec0ecfda684"}]}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] validate_networks() for [('94565cf9-f25f-4733-96b4-8ec0ecfda684', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Getting quotas for project 938a2ac3aa514d5ea63c1598221790f8. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Getting quotas for user 8b965155fa8a453f9f3ebbf5514bb96f and project 938a2ac3aa514d5ea63c1598221790f8. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:47:55 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:47:55 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-2a0a8754-5384-4f8e-a51a-bc2a5277c322 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.730951 Apr 20 10:47:55 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 138/412] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:47:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:47:55 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:55 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:55 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-93005677-0efa-41af-b6a8-29f72ae96173 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:47:55 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-93005677-0efa-41af-b6a8-29f72ae96173 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:47:55 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-93005677-0efa-41af-b6a8-29f72ae96173 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:47:55 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-93005677-0efa-41af-b6a8-29f72ae96173 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 200 len: 1210 microversion: 2.1 time: 0.077546 Apr 20 10:47:55 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 140/413] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:47:55 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 1210 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:47:57 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-9c7d532f-4af0-4438-b2f8-4a5fdbbcd4b9 req-90bd56c9-ab0d-4cf1-936b-da1cf9040386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0d597a-4eea-4938-92c6-c17d0a6c82e5", "tag": "5f63e57e-560d-426d-87da-b178c30bbb27"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:47:57 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:57 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:47:57 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-9c7d532f-4af0-4438-b2f8-4a5fdbbcd4b9 req-90bd56c9-ab0d-4cf1-936b-da1cf9040386 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:47:57 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-9c7d532f-4af0-4438-b2f8-4a5fdbbcd4b9 req-90bd56c9-ab0d-4cf1-936b-da1cf9040386 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:47:57 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-9c7d532f-4af0-4438-b2f8-4a5fdbbcd4b9 req-90bd56c9-ab0d-4cf1-936b-da1cf9040386 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:47:57 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-9c7d532f-4af0-4438-b2f8-4a5fdbbcd4b9 req-90bd56c9-ab0d-4cf1-936b-da1cf9040386 service nova] Creating event network-changed:5f63e57e-560d-426d-87da-b178c30bbb27 for instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 on user Apr 20 10:47:57 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-9c7d532f-4af0-4438-b2f8-4a5fdbbcd4b9 req-90bd56c9-ab0d-4cf1-936b-da1cf9040386 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036248 Apr 20 10:47:57 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 136/414] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:47:59 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-9d61dc3b-7e88-4c54-b050-bfb9f8c1c676 req-e437fee8-a55b-4294-8695-f2faa63b288b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0d597a-4eea-4938-92c6-c17d0a6c82e5", "name": "network-vif-plugged", "status": "completed", "tag": "5f63e57e-560d-426d-87da-b178c30bbb27"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:47:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-9d61dc3b-7e88-4c54-b050-bfb9f8c1c676 req-e437fee8-a55b-4294-8695-f2faa63b288b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:47:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-9d61dc3b-7e88-4c54-b050-bfb9f8c1c676 req-e437fee8-a55b-4294-8695-f2faa63b288b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:47:59 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-9d61dc3b-7e88-4c54-b050-bfb9f8c1c676 req-e437fee8-a55b-4294-8695-f2faa63b288b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:48:00 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-9d61dc3b-7e88-4c54-b050-bfb9f8c1c676 req-e437fee8-a55b-4294-8695-f2faa63b288b service nova] Creating event network-vif-plugged:5f63e57e-560d-426d-87da-b178c30bbb27 for instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 on user Apr 20 10:48:00 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-9d61dc3b-7e88-4c54-b050-bfb9f8c1c676 req-e437fee8-a55b-4294-8695-f2faa63b288b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042576 Apr 20 10:48:00 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 139/415] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:48:02 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-9ffde888-560b-4c0d-a611-2e8287b8ac45 req-7fbb77ac-f40a-41b3-b3f8-f61493048af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0d597a-4eea-4938-92c6-c17d0a6c82e5", "name": "network-vif-plugged", "status": "completed", "tag": "5f63e57e-560d-426d-87da-b178c30bbb27"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:48:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-9ffde888-560b-4c0d-a611-2e8287b8ac45 req-7fbb77ac-f40a-41b3-b3f8-f61493048af1 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:48:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-9ffde888-560b-4c0d-a611-2e8287b8ac45 req-7fbb77ac-f40a-41b3-b3f8-f61493048af1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:48:02 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-9ffde888-560b-4c0d-a611-2e8287b8ac45 req-7fbb77ac-f40a-41b3-b3f8-f61493048af1 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:48:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-9ffde888-560b-4c0d-a611-2e8287b8ac45 req-7fbb77ac-f40a-41b3-b3f8-f61493048af1 service nova] Creating event network-vif-plugged:5f63e57e-560d-426d-87da-b178c30bbb27 for instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 on user Apr 20 10:48:02 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-9ffde888-560b-4c0d-a611-2e8287b8ac45 req-7fbb77ac-f40a-41b3-b3f8-f61493048af1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029793 Apr 20 10:48:02 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 141/416] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:48:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:48:45 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:48:46 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:48:46 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-40d172f8-066b-4114-86e9-e00126f154be tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 200 len: 1493 microversion: 2.1 time: 0.495900 Apr 20 10:48:46 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 137/417] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:48:45 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 1493 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:46 user devstack@n-api.service[61649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:49:46 user devstack@n-api.service[61649]: Thu Apr 20 10:49:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1843635375", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "networks": [{"uuid": "94565cf9-f25f-4733-96b4-8ec0ecfda684"}]}} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.network.neutron [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] validate_networks() for [('94565cf9-f25f-4733-96b4-8ec0ecfda684', None, None, None, None, None)] {{(pid=61649) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Flavor limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Image limits 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Flavor pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Image pref 0:0:0 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.virt.hardware [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Getting quotas for project 938a2ac3aa514d5ea63c1598221790f8. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.quota [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Getting quotas for user 8b965155fa8a453f9f3ebbf5514bb96f and project 938a2ac3aa514d5ea63c1598221790f8. Resources: {'instances', 'ram', 'cores'} {{(pid=61649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Going to run 1 instances... {{(pid=61649) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:49:46 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:49:47 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-9cc62249-f41f-49aa-9c12-4ddce128fa89 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.582370 Apr 20 10:49:47 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 140/418] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:49:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:49:47 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:47 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:49:47 user devstack@n-api.service[61647]: Thu Apr 20 10:49:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c (ip 10.0.0.210) !!! Apr 20 10:49:47 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:47 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:47 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-33e84eed-b5b4-4bad-98e9-2a547cc31685 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:49:47 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-33e84eed-b5b4-4bad-98e9-2a547cc31685 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:49:47 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-33e84eed-b5b4-4bad-98e9-2a547cc31685 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:49:47 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-33e84eed-b5b4-4bad-98e9-2a547cc31685 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c" status: 200 len: 1211 microversion: 2.1 time: 0.073707 Apr 20 10:49:47 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 142/419] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:49:47 2023] GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c => generated 1211 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:49:49 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:49 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:49:49 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-df2b9494-9236-4dbe-af97-6bf7fa66aad7 req-f44ec148-8823-4ddb-be1f-6c1c90a49238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208031dc-1718-4e44-a856-34ceff17566c", "tag": "858caa47-a0cd-45bd-bf83-fefb4794bcb5"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:49:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-df2b9494-9236-4dbe-af97-6bf7fa66aad7 req-f44ec148-8823-4ddb-be1f-6c1c90a49238 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:49:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-df2b9494-9236-4dbe-af97-6bf7fa66aad7 req-f44ec148-8823-4ddb-be1f-6c1c90a49238 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:49:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-df2b9494-9236-4dbe-af97-6bf7fa66aad7 req-f44ec148-8823-4ddb-be1f-6c1c90a49238 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:49:49 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-df2b9494-9236-4dbe-af97-6bf7fa66aad7 req-f44ec148-8823-4ddb-be1f-6c1c90a49238 service nova] Creating event network-changed:858caa47-a0cd-45bd-bf83-fefb4794bcb5 for instance 208031dc-1718-4e44-a856-34ceff17566c on user Apr 20 10:49:49 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-df2b9494-9236-4dbe-af97-6bf7fa66aad7 req-f44ec148-8823-4ddb-be1f-6c1c90a49238 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038212 Apr 20 10:49:49 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 138/420] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:49:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:49:51 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-2ec0e0ea-4a9f-4c42-a1a8-253c784405a6 req-9fd89753-0f73-4bc1-8fe4-e18c8e6907e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208031dc-1718-4e44-a856-34ceff17566c", "name": "network-vif-plugged", "status": "completed", "tag": "858caa47-a0cd-45bd-bf83-fefb4794bcb5"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:49:51 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-2ec0e0ea-4a9f-4c42-a1a8-253c784405a6 req-9fd89753-0f73-4bc1-8fe4-e18c8e6907e3 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:49:51 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-2ec0e0ea-4a9f-4c42-a1a8-253c784405a6 req-9fd89753-0f73-4bc1-8fe4-e18c8e6907e3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:49:51 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-2ec0e0ea-4a9f-4c42-a1a8-253c784405a6 req-9fd89753-0f73-4bc1-8fe4-e18c8e6907e3 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:49:51 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-2ec0e0ea-4a9f-4c42-a1a8-253c784405a6 req-9fd89753-0f73-4bc1-8fe4-e18c8e6907e3 service nova] Creating event network-vif-plugged:858caa47-a0cd-45bd-bf83-fefb4794bcb5 for instance 208031dc-1718-4e44-a856-34ceff17566c on user Apr 20 10:49:51 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-2ec0e0ea-4a9f-4c42-a1a8-253c784405a6 req-9fd89753-0f73-4bc1-8fe4-e18c8e6907e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099826 Apr 20 10:49:51 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:49:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:49:53 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-b3071613-dd2c-4ab5-aed0-4b3f235c87f5 req-afa3cc75-1b98-4de6-b294-f0ab56645cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208031dc-1718-4e44-a856-34ceff17566c", "name": "network-vif-plugged", "status": "completed", "tag": "858caa47-a0cd-45bd-bf83-fefb4794bcb5"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:49:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-b3071613-dd2c-4ab5-aed0-4b3f235c87f5 req-afa3cc75-1b98-4de6-b294-f0ab56645cce service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:49:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-b3071613-dd2c-4ab5-aed0-4b3f235c87f5 req-afa3cc75-1b98-4de6-b294-f0ab56645cce service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:49:53 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-b3071613-dd2c-4ab5-aed0-4b3f235c87f5 req-afa3cc75-1b98-4de6-b294-f0ab56645cce service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:49:53 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-b3071613-dd2c-4ab5-aed0-4b3f235c87f5 req-afa3cc75-1b98-4de6-b294-f0ab56645cce service nova] Creating event network-vif-plugged:858caa47-a0cd-45bd-bf83-fefb4794bcb5 for instance 208031dc-1718-4e44-a856-34ceff17566c on user Apr 20 10:49:53 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-b3071613-dd2c-4ab5-aed0-4b3f235c87f5 req-afa3cc75-1b98-4de6-b294-f0ab56645cce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Apr 20 10:49:53 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 143/422] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:49:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:50:37 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:50:37 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-02ce9e28-2122-497b-8c4f-bacff9347386 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c" status: 200 len: 1494 microversion: 2.1 time: 0.334485 Apr 20 10:50:37 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 139/423] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:50:37 2023] GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c => generated 1494 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=4 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:51:37 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:51:37 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-973b5ea3-d088-4edc-9223-37f5b4ef62c2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c" status: 204 len: 0 microversion: 2.1 time: 0.129774 Apr 20 10:51:37 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:51:37 2023] DELETE /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:37 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:51:37 user devstack@n-api.service[61647]: Thu Apr 20 10:51:37 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c (ip 10.0.0.210) !!! Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:51:37 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:51:38 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:38 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:51:38 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:51:38 user devstack@n-api.service[61648]: Thu Apr 20 10:51:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 10:51:38 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:51:38 user devstack@n-api.service[61648]: Thu Apr 20 10:51:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 10:51:38 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-a5282434-884a-4b00-bc48-3691613b3bd7 req-8a2b83ff-5ff5-4484-aeea-f34fbafe1f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208031dc-1718-4e44-a856-34ceff17566c", "name": "network-vif-unplugged", "status": "completed", "tag": "858caa47-a0cd-45bd-bf83-fefb4794bcb5"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:51:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-a5282434-884a-4b00-bc48-3691613b3bd7 req-8a2b83ff-5ff5-4484-aeea-f34fbafe1f1b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:51:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-a5282434-884a-4b00-bc48-3691613b3bd7 req-8a2b83ff-5ff5-4484-aeea-f34fbafe1f1b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:51:38 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-a5282434-884a-4b00-bc48-3691613b3bd7 req-8a2b83ff-5ff5-4484-aeea-f34fbafe1f1b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:51:38 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-a5282434-884a-4b00-bc48-3691613b3bd7 req-8a2b83ff-5ff5-4484-aeea-f34fbafe1f1b service nova] Creating event network-vif-unplugged:858caa47-a0cd-45bd-bf83-fefb4794bcb5 for instance 208031dc-1718-4e44-a856-34ceff17566c on user Apr 20 10:51:38 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-a5282434-884a-4b00-bc48-3691613b3bd7 req-8a2b83ff-5ff5-4484-aeea-f34fbafe1f1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054116 Apr 20 10:51:38 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 140/425] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:51:38 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:51:38 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-f7b59862-d4af-4ef0-b0a5-0e6c82f33b8f tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c" status: 200 len: 1500 microversion: 2.1 time: 0.451363 Apr 20 10:51:38 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 144/426] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:51:37 2023] GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c => generated 1500 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:51:38 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-574b6f34-7525-4477-9414-b20eeba1f28e req-16acbfda-4035-475a-b4d5-35f2654f1b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208031dc-1718-4e44-a856-34ceff17566c", "name": "network-vif-deleted", "tag": "858caa47-a0cd-45bd-bf83-fefb4794bcb5"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:51:38 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-574b6f34-7525-4477-9414-b20eeba1f28e req-16acbfda-4035-475a-b4d5-35f2654f1b4f service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:51:38 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-574b6f34-7525-4477-9414-b20eeba1f28e req-16acbfda-4035-475a-b4d5-35f2654f1b4f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:51:38 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-574b6f34-7525-4477-9414-b20eeba1f28e req-16acbfda-4035-475a-b4d5-35f2654f1b4f service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:51:38 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-574b6f34-7525-4477-9414-b20eeba1f28e req-16acbfda-4035-475a-b4d5-35f2654f1b4f service nova] Creating event network-vif-deleted:858caa47-a0cd-45bd-bf83-fefb4794bcb5 for instance 208031dc-1718-4e44-a856-34ceff17566c on user Apr 20 10:51:38 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-574b6f34-7525-4477-9414-b20eeba1f28e req-16acbfda-4035-475a-b4d5-35f2654f1b4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081781 Apr 20 10:51:38 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 143/427] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:51:40 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-4b3fed1e-133f-4809-a27f-ac2054137a70 req-2e4c591d-a9e7-4c04-af79-0f22bb459339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208031dc-1718-4e44-a856-34ceff17566c", "name": "network-vif-plugged", "status": "completed", "tag": "858caa47-a0cd-45bd-bf83-fefb4794bcb5"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:51:40 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4b3fed1e-133f-4809-a27f-ac2054137a70 req-2e4c591d-a9e7-4c04-af79-0f22bb459339 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:51:40 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4b3fed1e-133f-4809-a27f-ac2054137a70 req-2e4c591d-a9e7-4c04-af79-0f22bb459339 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:51:40 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-4b3fed1e-133f-4809-a27f-ac2054137a70 req-2e4c591d-a9e7-4c04-af79-0f22bb459339 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:51:40 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-4b3fed1e-133f-4809-a27f-ac2054137a70 req-2e4c591d-a9e7-4c04-af79-0f22bb459339 service nova] Creating event network-vif-plugged:858caa47-a0cd-45bd-bf83-fefb4794bcb5 for instance 208031dc-1718-4e44-a856-34ceff17566c on user Apr 20 10:51:40 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-4b3fed1e-133f-4809-a27f-ac2054137a70 req-2e4c591d-a9e7-4c04-af79-0f22bb459339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038089 Apr 20 10:51:40 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 141/428] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:51:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:52:28 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] HTTP exception thrown: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Request method failure captured: Apr 20 10:52:28 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c HTTP/1.1 Apr 20 10:52:28 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:52:28 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:52:28 user devstack@n-api.service[61647]: Connection: close Apr 20 10:52:28 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:52:28 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:52:28 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:52:28 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:52:28 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRhaTCKILPfpqh_lcirTkynvSNHwhvrIxFk8mWq8jRPqiBBy6YnQKsdWCULV4KMo59aqqpqpLMIwEhzL9xR5W9XmHEHc03O0tq7sfYToB7C4ajOczXmnonGL3MBcs1pBkK79JeYxahniH-Z7zVmTFZr3iopMwCLDfgW9MCRgxdyfXZs Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Project-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Project-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Tenant: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Tenant-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:52:28 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:52:28 user devstack@n-api.service[61647]: X-User: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:52:28 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:52:28 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:52:28 user devstack@n-api.service[61647]: X-User-Id: 8b965155fa8a453f9f3ebbf5514bb96f Apr 20 10:52:28 user devstack@n-api.service[61647]: X-User-Name: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:52:28 user devstack@n-api.service[61647]: method: > Apr 20 10:52:28 user devstack@n-api.service[61647]: exception: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:52:28 user devstack@n-api.service[61647]: action_args: {'id': '208031dc-1718-4e44-a856-34ceff17566c'} Apr 20 10:52:28 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:52:28 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:52:28 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Returning 404 to user: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:52:28 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-bbf40f64-7bf0-4efa-8057-a40d29ce6744 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c" status: 404 len: 111 microversion: 2.1 time: 0.034775 Apr 20 10:52:28 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 145/429] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:52:28 2023] GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:52:28 user devstack@n-api.service[61649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 10:52:28 user devstack@n-api.service[61649]: Thu Apr 20 10:52:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 (ip 10.0.0.210) !!! Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:52:28 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:52:28 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-72eadd5f-976c-4a7a-921b-64a650d6c15c tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 200 len: 1493 microversion: 2.1 time: 0.296278 Apr 20 10:52:28 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 144/430] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:52:28 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 1493 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:53:30 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:53:30 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-ed27cbd1-99b3-4cad-89ca-1212059cc655 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 200 len: 1493 microversion: 2.1 time: 0.222103 Apr 20 10:53:30 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 142/431] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:53:30 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 1493 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:54:30 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:54:30 user devstack@n-api.service[61647]: Thu Apr 20 10:54:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 (ip 10.0.0.210) !!! Apr 20 10:54:30 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:54:30 user devstack@n-api.service[61647]: Thu Apr 20 10:54:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 (ip 10.0.0.210) !!! Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:54:30 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:54:30 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-346cf0f4-901a-46ff-bc7b-bfba6fb57866 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 200 len: 1493 microversion: 2.1 time: 0.238461 Apr 20 10:54:30 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 146/432] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:54:30 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 1493 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:55:32 user devstack@n-api.service[61649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:55:32 user devstack@n-api.service[61649]: Thu Apr 20 10:55:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 (ip 10.0.0.210) !!! Apr 20 10:55:32 user devstack@n-api.service[61649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:55:32 user devstack@n-api.service[61649]: Thu Apr 20 10:55:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 (ip 10.0.0.210) !!! Apr 20 10:55:32 user devstack@n-api.service[61649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 10:55:32 user devstack@n-api.service[61649]: Thu Apr 20 10:55:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 (ip 10.0.0.210) !!! Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:55:32 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:55:32 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-16d32613-c984-4ecb-b56a-dac165f0943b tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 200 len: 1493 microversion: 2.1 time: 0.249384 Apr 20 10:55:32 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 145/433] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:55:32 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 1493 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:56:32 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:56:32 user devstack@n-api.service[61648]: Thu Apr 20 10:56:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c (ip 10.0.0.210) !!! Apr 20 10:56:32 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:56:32 user devstack@n-api.service[61648]: Thu Apr 20 10:56:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c (ip 10.0.0.210) !!! Apr 20 10:56:32 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:56:32 user devstack@n-api.service[61648]: Thu Apr 20 10:56:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c (ip 10.0.0.210) !!! Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:32 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] HTTP exception thrown: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Request method failure captured: Apr 20 10:56:32 user devstack@n-api.service[61648]: request: DELETE /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c HTTP/1.1 Apr 20 10:56:32 user devstack@n-api.service[61648]: Accept: application/json Apr 20 10:56:32 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 10:56:32 user devstack@n-api.service[61648]: Connection: close Apr 20 10:56:32 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 10:56:32 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 10:56:32 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 10:56:32 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 10:56:32 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRhaTCKILPfpqh_lcirTkynvSNHwhvrIxFk8mWq8jRPqiBBy6YnQKsdWCULV4KMo59aqqpqpLMIwEhzL9xR5W9XmHEHc03O0tq7sfYToB7C4ajOczXmnonGL3MBcs1pBkK79JeYxahniH-Z7zVmTFZr3iopMwCLDfgW9MCRgxdyfXZs Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Project-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Project-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Tenant: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Tenant-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:56:32 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:56:32 user devstack@n-api.service[61648]: X-User: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:56:32 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 10:56:32 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 10:56:32 user devstack@n-api.service[61648]: X-User-Id: 8b965155fa8a453f9f3ebbf5514bb96f Apr 20 10:56:32 user devstack@n-api.service[61648]: X-User-Name: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:56:32 user devstack@n-api.service[61648]: method: > Apr 20 10:56:32 user devstack@n-api.service[61648]: exception: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61648]: action_args: {'id': '208031dc-1718-4e44-a856-34ceff17566c'} Apr 20 10:56:32 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Returning 404 to user: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:56:32 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-d8ce772f-fe0d-4036-881c-c80c8798d0b8 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c" status: 404 len: 111 microversion: 2.1 time: 0.105191 Apr 20 10:56:32 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 143/434] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:56:32 2023] DELETE /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 208031dc-1718-4e44-a856-34ceff17566c] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:32 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] HTTP exception thrown: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Request method failure captured: Apr 20 10:56:32 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c HTTP/1.1 Apr 20 10:56:32 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:56:32 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:56:32 user devstack@n-api.service[61647]: Connection: close Apr 20 10:56:32 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:56:32 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:56:32 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:56:32 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:56:32 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRhaTCKILPfpqh_lcirTkynvSNHwhvrIxFk8mWq8jRPqiBBy6YnQKsdWCULV4KMo59aqqpqpLMIwEhzL9xR5W9XmHEHc03O0tq7sfYToB7C4ajOczXmnonGL3MBcs1pBkK79JeYxahniH-Z7zVmTFZr3iopMwCLDfgW9MCRgxdyfXZs Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Project-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Project-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Tenant: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Tenant-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:56:32 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:56:32 user devstack@n-api.service[61647]: X-User: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:56:32 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:56:32 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:56:32 user devstack@n-api.service[61647]: X-User-Id: 8b965155fa8a453f9f3ebbf5514bb96f Apr 20 10:56:32 user devstack@n-api.service[61647]: X-User-Name: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:56:32 user devstack@n-api.service[61647]: method: > Apr 20 10:56:32 user devstack@n-api.service[61647]: exception: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61647]: action_args: {'id': '208031dc-1718-4e44-a856-34ceff17566c'} Apr 20 10:56:32 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. Apr 20 10:56:32 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:56:32 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Returning 404 to user: Instance 208031dc-1718-4e44-a856-34ceff17566c could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:56:32 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-89f1003d-f2b9-4140-9f69-af2eea69294a tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c" status: 404 len: 111 microversion: 2.1 time: 0.046155 Apr 20 10:56:32 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 147/435] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:56:32 2023] GET /compute/v2.1/servers/208031dc-1718-4e44-a856-34ceff17566c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:32 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:56:33 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-27bb2d72-a227-495a-8ea0-209fa8cb5bd2 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 204 len: 0 microversion: 2.1 time: 0.143619 Apr 20 10:56:33 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:56:32 2023] DELETE /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:33 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-a8f23d70-fb9b-4afb-967e-600f9d23b932 req-554ddce6-631d-47dd-911c-8dd64bbd7ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0d597a-4eea-4938-92c6-c17d0a6c82e5", "name": "network-vif-unplugged", "status": "completed", "tag": "5f63e57e-560d-426d-87da-b178c30bbb27"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:56:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a8f23d70-fb9b-4afb-967e-600f9d23b932 req-554ddce6-631d-47dd-911c-8dd64bbd7ea6 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a8f23d70-fb9b-4afb-967e-600f9d23b932 req-554ddce6-631d-47dd-911c-8dd64bbd7ea6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:33 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-a8f23d70-fb9b-4afb-967e-600f9d23b932 req-554ddce6-631d-47dd-911c-8dd64bbd7ea6 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:33 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-a8f23d70-fb9b-4afb-967e-600f9d23b932 req-554ddce6-631d-47dd-911c-8dd64bbd7ea6 service nova] Creating event network-vif-unplugged:5f63e57e-560d-426d-87da-b178c30bbb27 for instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 on user Apr 20 10:56:33 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-a8f23d70-fb9b-4afb-967e-600f9d23b932 req-554ddce6-631d-47dd-911c-8dd64bbd7ea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030818 Apr 20 10:56:33 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 148/437] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:56:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 10:56:33 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b965155fa8a453f9f3ebbf5514bb96f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938a2ac3aa514d5ea63c1598221790f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:56:33 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-1d41e435-6dc7-43e0-8d56-a82be1edc087 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 200 len: 1499 microversion: 2.1 time: 0.479771 Apr 20 10:56:33 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 144/438] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:56:33 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 1499 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:56:35 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-e784eddb-0bc6-4519-be09-e6b9b8c9afe1 req-2ef96aad-692f-4305-8b51-73ab8dcabc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0d597a-4eea-4938-92c6-c17d0a6c82e5", "name": "network-vif-plugged", "status": "completed", "tag": "5f63e57e-560d-426d-87da-b178c30bbb27"}, {"server_uuid": "6a0d597a-4eea-4938-92c6-c17d0a6c82e5", "name": "network-vif-deleted", "tag": "5f63e57e-560d-426d-87da-b178c30bbb27"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:56:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e784eddb-0bc6-4519-be09-e6b9b8c9afe1 req-2ef96aad-692f-4305-8b51-73ab8dcabc20 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:56:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e784eddb-0bc6-4519-be09-e6b9b8c9afe1 req-2ef96aad-692f-4305-8b51-73ab8dcabc20 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:56:35 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-e784eddb-0bc6-4519-be09-e6b9b8c9afe1 req-2ef96aad-692f-4305-8b51-73ab8dcabc20 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:56:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-e784eddb-0bc6-4519-be09-e6b9b8c9afe1 req-2ef96aad-692f-4305-8b51-73ab8dcabc20 service nova] Creating event network-vif-plugged:5f63e57e-560d-426d-87da-b178c30bbb27 for instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 on user Apr 20 10:56:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-e784eddb-0bc6-4519-be09-e6b9b8c9afe1 req-2ef96aad-692f-4305-8b51-73ab8dcabc20 service nova] Creating event network-vif-deleted:5f63e57e-560d-426d-87da-b178c30bbb27 for instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 on user Apr 20 10:56:35 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-e784eddb-0bc6-4519-be09-e6b9b8c9afe1 req-2ef96aad-692f-4305-8b51-73ab8dcabc20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034066 Apr 20 10:56:35 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:56:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:23 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 10:57:23 user devstack@n-api.service[61647]: Thu Apr 20 10:57:23 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 (ip 10.0.0.210) !!! Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] [instance: 6a0d597a-4eea-4938-92c6-c17d0a6c82e5] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:57:23 user devstack@n-api.service[61647]: INFO nova.api.openstack.wsgi [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] HTTP exception thrown: Instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 could not be found. Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Request method failure captured: Apr 20 10:57:23 user devstack@n-api.service[61647]: request: GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 HTTP/1.1 Apr 20 10:57:23 user devstack@n-api.service[61647]: Accept: application/json Apr 20 10:57:23 user devstack@n-api.service[61647]: Accept-Encoding: identity Apr 20 10:57:23 user devstack@n-api.service[61647]: Connection: close Apr 20 10:57:23 user devstack@n-api.service[61647]: Content-Length: 0 Apr 20 10:57:23 user devstack@n-api.service[61647]: Content-Type: application/json Apr 20 10:57:23 user devstack@n-api.service[61647]: Host: 10.0.0.210 Apr 20 10:57:23 user devstack@n-api.service[61647]: Openstack-System-Scope: None Apr 20 10:57:23 user devstack@n-api.service[61647]: User-Agent: python-urllib3/1.26.15 Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Auth-Token: gAAAAABkQRhaTCKILPfpqh_lcirTkynvSNHwhvrIxFk8mWq8jRPqiBBy6YnQKsdWCULV4KMo59aqqpqpLMIwEhzL9xR5W9XmHEHc03O0tq7sfYToB7C4ajOczXmnonGL3MBcs1pBkK79JeYxahniH-Z7zVmTFZr3iopMwCLDfgW9MCRgxdyfXZs Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Domain-Id: None Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Domain-Name: None Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Identity-Status: Confirmed Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Is-Admin-Project: True Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Project-Domain-Id: default Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Project-Domain-Name: Default Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Project-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Project-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Role: member,reader Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Roles: member,reader Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/938a2ac3aa514d5ea63c1598221790f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Tenant: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Tenant-Id: 938a2ac3aa514d5ea63c1598221790f8 Apr 20 10:57:23 user devstack@n-api.service[61647]: X-Tenant-Name: tempest-ServersNegativeTestJSON-284593456 Apr 20 10:57:23 user devstack@n-api.service[61647]: X-User: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:57:23 user devstack@n-api.service[61647]: X-User-Domain-Id: default Apr 20 10:57:23 user devstack@n-api.service[61647]: X-User-Domain-Name: Default Apr 20 10:57:23 user devstack@n-api.service[61647]: X-User-Id: 8b965155fa8a453f9f3ebbf5514bb96f Apr 20 10:57:23 user devstack@n-api.service[61647]: X-User-Name: tempest-ServersNegativeTestJSON-284593456-project-member Apr 20 10:57:23 user devstack@n-api.service[61647]: method: > Apr 20 10:57:23 user devstack@n-api.service[61647]: exception: Instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 could not be found. Apr 20 10:57:23 user devstack@n-api.service[61647]: action_args: {'id': '6a0d597a-4eea-4938-92c6-c17d0a6c82e5'} Apr 20 10:57:23 user devstack@n-api.service[61647]: {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 could not be found. Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 could not be found. Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 could not be found. Apr 20 10:57:23 user devstack@n-api.service[61647]: ERROR nova.api.openstack.wsgi Apr 20 10:57:23 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] Returning 404 to user: Instance 6a0d597a-4eea-4938-92c6-c17d0a6c82e5 could not be found. {{(pid=61647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:57:23 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-92698f51-fee2-4712-8358-b1dd761b93a1 tempest-ServersNegativeTestJSON-284593456 tempest-ServersNegativeTestJSON-284593456-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5" status: 404 len: 111 microversion: 2.1 time: 0.038641 Apr 20 10:57:23 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 149/440] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:57:23 2023] GET /compute/v2.1/servers/6a0d597a-4eea-4938-92c6-c17d0a6c82e5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 10:57:27 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:27 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=8 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:27 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-01461486-072b-4d87-bbac-7ea6d8b14d5f tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] Action: 'create', calling method: .version_select at 0x7f122a349cf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1067773048", "metadata": {"Type": "work"}}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:57:28 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-01461486-072b-4d87-bbac-7ea6d8b14d5f tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.496148 Apr 20 10:57:28 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 145/441] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 10:57:27 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 498 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 10:57:28 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:28 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:28 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-ec244376-57f6-4a45-85ef-ac49ab856bf6 tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] Calling method '.version_select at 0x7f122a552830>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:57:28 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-ec244376-57f6-4a45-85ef-ac49ab856bf6 tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d" status: 200 len: 350 microversion: 2.1 time: 0.064104 Apr 20 10:57:28 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 10:57:28 2023] GET /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:57:29 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-56c42ac2-26d6-4dc9-b4f2-cf1fb1d818f9 tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] Calling method '.version_select at 0x7f122a33db40>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:57:29 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-56c42ac2-26d6-4dc9-b4f2-cf1fb1d818f9 tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d" status: 200 len: 350 microversion: 2.1 time: 0.169245 Apr 20 10:57:29 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 150/443] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 10:57:29 2023] GET /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d => generated 350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:57:29 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-5ad1f5b7-1b1e-42c4-a76d-1f6d09d637ef tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] Calling method '.version_select at 0x7f122a348940>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:57:29 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-5ad1f5b7-1b1e-42c4-a76d-1f6d09d637ef tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d" status: 202 len: 0 microversion: 2.1 time: 0.118000 Apr 20 10:57:29 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 146/444] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 10:57:29 2023] DELETE /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 10:57:29 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-eaf33082-d25a-43ef-a5a2-3d64dc06707d tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] Calling method '.version_select at 0x7f122a550d30>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:57:29 user devstack@n-api.service[61649]: INFO nova.api.openstack.wsgi [None req-eaf33082-d25a-43ef-a5a2-3d64dc06707d tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] HTTP exception thrown: Volume 4939a1dd-0033-4f2c-a4ef-62dc23dc767d could not be found. Apr 20 10:57:29 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-eaf33082-d25a-43ef-a5a2-3d64dc06707d tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] Request method failure captured: Apr 20 10:57:29 user devstack@n-api.service[61649]: request: GET /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d HTTP/1.1 Apr 20 10:57:29 user devstack@n-api.service[61649]: Accept: application/json Apr 20 10:57:29 user devstack@n-api.service[61649]: Accept-Encoding: identity Apr 20 10:57:29 user devstack@n-api.service[61649]: Connection: close Apr 20 10:57:29 user devstack@n-api.service[61649]: Content-Length: 0 Apr 20 10:57:29 user devstack@n-api.service[61649]: Content-Type: application/json Apr 20 10:57:29 user devstack@n-api.service[61649]: Host: 10.0.0.210 Apr 20 10:57:29 user devstack@n-api.service[61649]: Openstack-System-Scope: None Apr 20 10:57:29 user devstack@n-api.service[61649]: User-Agent: python-urllib3/1.26.15 Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Auth-Token: gAAAAABkQRqXRx30ufCOHEvh8UpZYA28ziC-CASXJBDSU5fHZ78XIE8RqV492LNS8S8x0PJTZ-yohXuGqL-Ad283uIbBrLfizOaK-hS8BEtScYMC0etEKx-mn_oIqkLCRM2nryVC_--b8zyukKNMB-ecoo2PsZvuNFDiOZ4Cm-61sU3UAdymVwk Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Domain-Id: None Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Domain-Name: None Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Identity-Status: Confirmed Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Is-Admin-Project: True Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Project-Domain-Id: default Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Project-Domain-Name: Default Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Project-Id: a22f488a63a74b67bb794d406b7a91ab Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Project-Name: tempest-VolumesGetTestJSON-1621184146 Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Role: member,reader Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Roles: member,reader Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a22f488a63a74b67bb794d406b7a91ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a22f488a63a74b67bb794d406b7a91ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a22f488a63a74b67bb794d406b7a91ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Tenant: tempest-VolumesGetTestJSON-1621184146 Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Tenant-Id: a22f488a63a74b67bb794d406b7a91ab Apr 20 10:57:29 user devstack@n-api.service[61649]: X-Tenant-Name: tempest-VolumesGetTestJSON-1621184146 Apr 20 10:57:29 user devstack@n-api.service[61649]: X-User: tempest-VolumesGetTestJSON-1621184146-project-member Apr 20 10:57:29 user devstack@n-api.service[61649]: X-User-Domain-Id: default Apr 20 10:57:29 user devstack@n-api.service[61649]: X-User-Domain-Name: Default Apr 20 10:57:29 user devstack@n-api.service[61649]: X-User-Id: 9c8bf3818fee47ca9e4944739f3dba47 Apr 20 10:57:29 user devstack@n-api.service[61649]: X-User-Name: tempest-VolumesGetTestJSON-1621184146-project-member Apr 20 10:57:29 user devstack@n-api.service[61649]: method: Apr 20 10:57:29 user devstack@n-api.service[61649]: exception: Volume 4939a1dd-0033-4f2c-a4ef-62dc23dc767d could not be found. Apr 20 10:57:29 user devstack@n-api.service[61649]: action_args: {'id': '4939a1dd-0033-4f2c-a4ef-62dc23dc767d'} Apr 20 10:57:29 user devstack@n-api.service[61649]: {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4939a1dd-0033-4f2c-a4ef-62dc23dc767d could not be found. (HTTP 404) (Request-ID: req-ce8ff61c-ca25-44f6-89f9-d411012f732a) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4939a1dd-0033-4f2c-a4ef-62dc23dc767d could not be found. Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4939a1dd-0033-4f2c-a4ef-62dc23dc767d could not be found. Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4939a1dd-0033-4f2c-a4ef-62dc23dc767d could not be found. Apr 20 10:57:29 user devstack@n-api.service[61649]: ERROR nova.api.openstack.wsgi Apr 20 10:57:29 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-eaf33082-d25a-43ef-a5a2-3d64dc06707d tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] Returning 404 to user: Volume 4939a1dd-0033-4f2c-a4ef-62dc23dc767d could not be found. {{(pid=61649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 10:57:29 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-eaf33082-d25a-43ef-a5a2-3d64dc06707d tempest-VolumesGetTestJSON-1621184146 tempest-VolumesGetTestJSON-1621184146-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d" status: 404 len: 109 microversion: 2.1 time: 0.091237 Apr 20 10:57:29 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 149/445] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 10:57:29 2023] GET /compute/v2.1/os-volumes/4939a1dd-0033-4f2c-a4ef-62dc23dc767d => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 10:57:56 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:56 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:57:56 user devstack@n-api.service[61647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:57:56 user devstack@n-api.service[61647]: Thu Apr 20 10:57:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 20 10:57:56 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-0f984928-cddf-4d23-95fb-13c15890c9e9 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Action: 'create', calling method: .version_select at 0x7f122a33d870>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-590761624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBPIT+VvH3x2WPe1QtbwJQBTzLEjebnVimjNNjbfbb27yWLPSdAy/C41BLBv8diKVmHQXGuhKLbD0OVFASZoKFC6Q50u+178oCkH5VTSnQCVI+WIQW8XWFJi1FKNNpilg=="}} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:57:56 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-0f984928-cddf-4d23-95fb-13c15890c9e9 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Getting quotas for project 730b5f2c76df4e769572f6296407c103. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:57:56 user devstack@n-api.service[61647]: DEBUG nova.quota [None req-0f984928-cddf-4d23-95fb-13c15890c9e9 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Getting quotas for user 1efe465dafde459899d76107759d64e9 and project 730b5f2c76df4e769572f6296407c103. Resources: {'key_pairs'} {{(pid=61647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:57:56 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-0f984928-cddf-4d23-95fb-13c15890c9e9 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.268642 Apr 20 10:57:56 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 151/446] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 10:57:56 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:57:57 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1487722819", "imageRef": "3687b278-c2bc-46f2-9b7e-579c8d06fe41", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-590761624", "security_groups": [{"name": "tempest-secgroup-smoke-1331080404"}], "networks": [{"uuid": "52844f20-cd97-4994-ae95-56c25466dfd5"}]}} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:57:57 user devstack@n-api.service[61648]: DEBUG nova.network.neutron [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] validate_networks() for [('52844f20-cd97-4994-ae95-56c25466dfd5', None, None, None, None, None)] {{(pid=61648) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Flavor limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Image limits 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Flavor pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Image pref 0:0:0 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.virt.hardware [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Getting quotas for project 730b5f2c76df4e769572f6296407c103. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.quota [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Getting quotas for user 1efe465dafde459899d76107759d64e9 and project 730b5f2c76df4e769572f6296407c103. Resources: {'instances', 'ram', 'cores'} {{(pid=61648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Going to run 1 instances... {{(pid=61648) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 10:57:58 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3687b278-c2bc-46f2-9b7e-579c8d06fe41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 10:57:58 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-e1b4df8f-7bf7-42b9-ba77-f934574438c7 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.870095 Apr 20 10:57:58 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 147/447] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 10:57:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 10:57:58 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-3c111145-0a4a-4e92-aced-c7fca249aeac tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:57:58 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-3c111145-0a4a-4e92-aced-c7fca249aeac tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:57:58 user devstack@n-api.service[61649]: DEBUG nova.policy [None req-3c111145-0a4a-4e92-aced-c7fca249aeac tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efe465dafde459899d76107759d64e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730b5f2c76df4e769572f6296407c103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61649) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:57:58 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-3c111145-0a4a-4e92-aced-c7fca249aeac tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af" status: 200 len: 1256 microversion: 2.1 time: 0.078749 Apr 20 10:57:58 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 150/448] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:57:58 2023] GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af => generated 1256 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:58:01 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [req-2078e028-bb30-4ea3-b086-a06c62dd4bc4 req-74a8d581-7f37-491c-8ead-0f9fcd7cbdab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}]} {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:58:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-2078e028-bb30-4ea3-b086-a06c62dd4bc4 req-74a8d581-7f37-491c-8ead-0f9fcd7cbdab service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:58:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-2078e028-bb30-4ea3-b086-a06c62dd4bc4 req-74a8d581-7f37-491c-8ead-0f9fcd7cbdab service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:58:01 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [req-2078e028-bb30-4ea3-b086-a06c62dd4bc4 req-74a8d581-7f37-491c-8ead-0f9fcd7cbdab service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:58:01 user devstack@n-api.service[61647]: INFO nova.api.openstack.compute.server_external_events [req-2078e028-bb30-4ea3-b086-a06c62dd4bc4 req-74a8d581-7f37-491c-8ead-0f9fcd7cbdab service nova] Creating event network-changed:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:58:01 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [req-2078e028-bb30-4ea3-b086-a06c62dd4bc4 req-74a8d581-7f37-491c-8ead-0f9fcd7cbdab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081064 Apr 20 10:58:01 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 152/449] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:58:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:58:03 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-0537b6c4-9264-418f-a813-f790ff35ed43 req-05534082-6ed7-4bd9-b473-57688b9e7037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:58:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-0537b6c4-9264-418f-a813-f790ff35ed43 req-05534082-6ed7-4bd9-b473-57688b9e7037 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:58:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-0537b6c4-9264-418f-a813-f790ff35ed43 req-05534082-6ed7-4bd9-b473-57688b9e7037 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:58:03 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-0537b6c4-9264-418f-a813-f790ff35ed43 req-05534082-6ed7-4bd9-b473-57688b9e7037 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:58:03 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-0537b6c4-9264-418f-a813-f790ff35ed43 req-05534082-6ed7-4bd9-b473-57688b9e7037 service nova] Creating event network-vif-plugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:58:03 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-0537b6c4-9264-418f-a813-f790ff35ed43 req-05534082-6ed7-4bd9-b473-57688b9e7037 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035991 Apr 20 10:58:03 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 148/450] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:58:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:58:05 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-ad6565e4-c854-4111-b7c9-67d170d7f737 req-ebdb60cc-a112-4760-a319-5a88a1a0993c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:58:05 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-ad6565e4-c854-4111-b7c9-67d170d7f737 req-ebdb60cc-a112-4760-a319-5a88a1a0993c service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:58:05 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-ad6565e4-c854-4111-b7c9-67d170d7f737 req-ebdb60cc-a112-4760-a319-5a88a1a0993c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:58:05 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-ad6565e4-c854-4111-b7c9-67d170d7f737 req-ebdb60cc-a112-4760-a319-5a88a1a0993c service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:58:05 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-ad6565e4-c854-4111-b7c9-67d170d7f737 req-ebdb60cc-a112-4760-a319-5a88a1a0993c service nova] Creating event network-vif-plugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:58:05 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-ad6565e4-c854-4111-b7c9-67d170d7f737 req-ebdb60cc-a112-4760-a319-5a88a1a0993c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031961 Apr 20 10:58:05 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 151/451] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:58:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell0:SELECT=4 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:58:48 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:58:49 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efe465dafde459899d76107759d64e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730b5f2c76df4e769572f6296407c103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:58:49 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-cb6cb5a2-e9f0-423e-bf88-75176b142385 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af" status: 200 len: 1568 microversion: 2.1 time: 0.219497 Apr 20 10:58:49 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:58:48 2023] GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=2 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell0:SELECT=6 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:49 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 10:59:49 user devstack@n-api.service[61648]: Thu Apr 20 10:59:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af (ip 10.0.0.210) !!! Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:49 user devstack@n-api.service[61648]: DEBUG nova.policy [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efe465dafde459899d76107759d64e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730b5f2c76df4e769572f6296407c103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61648) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:59:49 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-14d1560b-b8d8-4471-834b-23184e180090 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af" status: 200 len: 1568 microversion: 2.1 time: 0.242451 Apr 20 10:59:49 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 149/453] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:59:49 2023] GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell0:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_api:SELECT=6 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG dbcounter [-] [61649] Writing DB stats nova_cell1:SELECT=2 {{(pid=61649) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Calling method '>' {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] Fetching instance by UUID {{(pid=61649) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:50 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:51 user devstack@n-api.service[61649]: DEBUG nova.compute.api [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] Going to try to terminate instance {{(pid=61649) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 10:59:51 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [None req-4139d69d-c636-4f9a-97e1-cd2867ca2962 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af" status: 204 len: 0 microversion: 2.1 time: 0.129066 Apr 20 10:59:51 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 152/454] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 10:59:50 2023] DELETE /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Calling method '>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG nova.compute.api [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] Fetching instance by UUID {{(pid=61647) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG oslo_concurrency.lockutils [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61647) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:51 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [req-0e603176-a582-49b1-8c3d-8451e1a92737 req-0525f720-82d1-4d4e-9b81-e3c35a666cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-unplugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}]} {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:59:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-0e603176-a582-49b1-8c3d-8451e1a92737 req-0525f720-82d1-4d4e-9b81-e3c35a666cf2 service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-0e603176-a582-49b1-8c3d-8451e1a92737 req-0525f720-82d1-4d4e-9b81-e3c35a666cf2 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:51 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [req-0e603176-a582-49b1-8c3d-8451e1a92737 req-0525f720-82d1-4d4e-9b81-e3c35a666cf2 service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:51 user devstack@n-api.service[61648]: INFO nova.api.openstack.compute.server_external_events [req-0e603176-a582-49b1-8c3d-8451e1a92737 req-0525f720-82d1-4d4e-9b81-e3c35a666cf2 service nova] Creating event network-vif-unplugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:59:51 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [req-0e603176-a582-49b1-8c3d-8451e1a92737 req-0525f720-82d1-4d4e-9b81-e3c35a666cf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034436 Apr 20 10:59:51 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 150/455] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 10:59:51 user devstack@n-api.service[61647]: DEBUG nova.policy [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1efe465dafde459899d76107759d64e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730b5f2c76df4e769572f6296407c103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61647) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 10:59:51 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-58f481ed-5c8f-4460-a3e8-c82a66afa449 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af" status: 200 len: 1574 microversion: 2.1 time: 0.265986 Apr 20 10:59:51 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 10:59:51 2023] GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af => generated 1574 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 10:59:53 user devstack@n-api.service[61649]: DEBUG nova.api.openstack.wsgi [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}, {"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}, {"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}, {"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-unplugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}, {"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-deleted", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}, {"server_uuid": "2874b7cd-8c61-46d5-a949-8a8c2469b9af", "name": "network-vif-plugged", "status": "completed", "tag": "7a0b25cb-ada6-4f3c-bdd7-a9c65d503530"}]} {{(pid=61649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 10:59:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 10:59:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 10:59:53 user devstack@n-api.service[61649]: DEBUG oslo_concurrency.lockutils [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61649) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 10:59:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Creating event network-vif-plugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:59:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Creating event network-vif-plugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:59:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Creating event network-vif-plugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:59:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Creating event network-vif-unplugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:59:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Creating event network-vif-deleted:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:59:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.compute.server_external_events [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] Creating event network-vif-plugged:7a0b25cb-ada6-4f3c-bdd7-a9c65d503530 for instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af on user Apr 20 10:59:53 user devstack@n-api.service[61649]: INFO nova.api.openstack.requestlog [req-dff7ca3a-985a-4572-a702-37c56f23877c req-94ae1215-cea3-4c14-b5cb-4bf4699d334b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.032872 Apr 20 10:59:53 user devstack@n-api.service[61649]: [pid: 61649|app: 0|req: 153/457] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 10:59:53 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_api:SELECT=4 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG dbcounter [-] [61648] Writing DB stats nova_cell1:SELECT=8 {{(pid=61648) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 11:00:41 user devstack@n-api.service[61648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 11:00:41 user devstack@n-api.service[61648]: Thu Apr 20 11:00:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af (ip 10.0.0.210) !!! Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Calling method '>' {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG nova.compute.api [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] [instance: 2874b7cd-8c61-46d5-a949-8a8c2469b9af] Fetching instance by UUID {{(pid=61648) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Acquiring lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG oslo_concurrency.lockutils [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Lock "f21b7af8-f4f6-43eb-856a-0fb219d1bf22" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61648) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 11:00:41 user devstack@n-api.service[61648]: INFO nova.api.openstack.wsgi [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] HTTP exception thrown: Instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af could not be found. Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Request method failure captured: Apr 20 11:00:41 user devstack@n-api.service[61648]: request: GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af HTTP/1.1 Apr 20 11:00:41 user devstack@n-api.service[61648]: Accept: application/json Apr 20 11:00:41 user devstack@n-api.service[61648]: Accept-Encoding: identity Apr 20 11:00:41 user devstack@n-api.service[61648]: Connection: close Apr 20 11:00:41 user devstack@n-api.service[61648]: Content-Length: 0 Apr 20 11:00:41 user devstack@n-api.service[61648]: Content-Type: application/json Apr 20 11:00:41 user devstack@n-api.service[61648]: Host: 10.0.0.210 Apr 20 11:00:41 user devstack@n-api.service[61648]: Openstack-System-Scope: None Apr 20 11:00:41 user devstack@n-api.service[61648]: User-Agent: python-urllib3/1.26.15 Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Auth-Token: gAAAAABkQRqtP6dhjqn94XPR5PLugNPKSE2rf4D_G-5OgFEAyBdD_2qaeyRByhAk9otYPI8h-lrIQ-68TsBtuCcQh5wNYKgeEiH8iJcr3jLCkHI7c00VvXgke1KtTWsXmh61GcFKcP8PPq4q7YTRNGpDi74yxK8bKosPrxY6w1dFrUF9DiA3uPg Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Domain-Id: None Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Domain-Name: None Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Identity-Status: Confirmed Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Is-Admin-Project: True Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Project-Domain-Id: default Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Project-Domain-Name: Default Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Project-Id: 730b5f2c76df4e769572f6296407c103 Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Project-Name: tempest-SnapshotDataIntegrityTests-268465305 Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Role: member,reader Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Roles: member,reader Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/730b5f2c76df4e769572f6296407c103"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/730b5f2c76df4e769572f6296407c103"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/730b5f2c76df4e769572f6296407c103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Tenant: tempest-SnapshotDataIntegrityTests-268465305 Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Tenant-Id: 730b5f2c76df4e769572f6296407c103 Apr 20 11:00:41 user devstack@n-api.service[61648]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-268465305 Apr 20 11:00:41 user devstack@n-api.service[61648]: X-User: tempest-SnapshotDataIntegrityTests-268465305-project-member Apr 20 11:00:41 user devstack@n-api.service[61648]: X-User-Domain-Id: default Apr 20 11:00:41 user devstack@n-api.service[61648]: X-User-Domain-Name: Default Apr 20 11:00:41 user devstack@n-api.service[61648]: X-User-Id: 1efe465dafde459899d76107759d64e9 Apr 20 11:00:41 user devstack@n-api.service[61648]: X-User-Name: tempest-SnapshotDataIntegrityTests-268465305-project-member Apr 20 11:00:41 user devstack@n-api.service[61648]: method: > Apr 20 11:00:41 user devstack@n-api.service[61648]: exception: Instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af could not be found. Apr 20 11:00:41 user devstack@n-api.service[61648]: action_args: {'id': '2874b7cd-8c61-46d5-a949-8a8c2469b9af'} Apr 20 11:00:41 user devstack@n-api.service[61648]: {{(pid=61648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af could not be found. Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af could not be found. Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af could not be found. Apr 20 11:00:41 user devstack@n-api.service[61648]: ERROR nova.api.openstack.wsgi Apr 20 11:00:41 user devstack@n-api.service[61648]: DEBUG nova.api.openstack.wsgi [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Returning 404 to user: Instance 2874b7cd-8c61-46d5-a949-8a8c2469b9af could not be found. {{(pid=61648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 11:00:41 user devstack@n-api.service[61648]: INFO nova.api.openstack.requestlog [None req-d06aa301-382d-436d-95fa-66615a6dc4e1 tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af" status: 404 len: 111 microversion: 2.1 time: 0.039075 Apr 20 11:00:41 user devstack@n-api.service[61648]: [pid: 61648|app: 0|req: 151/458] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 11:00:41 2023] GET /compute/v2.1/servers/2874b7cd-8c61-46d5-a949-8a8c2469b9af => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 11:00:41 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_api:SELECT=2 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 11:00:41 user devstack@n-api.service[61647]: DEBUG dbcounter [-] [61647] Writing DB stats nova_cell1:SELECT=6 {{(pid=61647) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 11:00:41 user devstack@n-api.service[61647]: DEBUG nova.api.openstack.wsgi [None req-4b58f1e2-9583-4549-a03b-9132cb10169e tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] Calling method '.version_select at 0x7f122a4d95a0>' {{(pid=61647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 11:00:41 user devstack@n-api.service[61647]: INFO nova.api.openstack.requestlog [None req-4b58f1e2-9583-4549-a03b-9132cb10169e tempest-SnapshotDataIntegrityTests-268465305 tempest-SnapshotDataIntegrityTests-268465305-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-590761624" status: 202 len: 0 microversion: 2.1 time: 0.031127 Apr 20 11:00:41 user devstack@n-api.service[61647]: [pid: 61647|app: 0|req: 155/459] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 11:00:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-590761624 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)